User-Agent: * Disallow: /site/ Disallow: /site/* Disallow: /archivi/ Disallow: /archivi/* Disallow: /assets_admin/* Disallow: /premium_web_system/* # disallow all files ending in .php Disallow: /*.php$ Disallow: /*.js$ Disallow: /*.inc$ Disallow: /*.css$ Disallow: /*.txt$