User-Agent: * Disallow: /admin/ Disallow: /admin/* Disallow: /files/ Disallow: /files/* # disallow all files ending in .php Disallow: /*.php$ Disallow: /*.js$ Disallow: /*.inc$ Disallow: /*.css$ Disallow: /*.txt$