# temporarily disallow ALL indexing... # User-agent: * # Disallow: / # Directory disallows... User-agent: * Disallow: /cgibin/ Disallow: /pilot/ Disallow: /traffic/ Disallow: /editors/ Disallow: /meta/ Disallow: /results/ Disallow: /traffic/ Disallow: /logs/ Disallow: /js/ Disallow: /frags/ Disallow: /php/ Disallow: /wp/ Disallow: /imgs/ Disallow: /images/ Disallow: /photos/ Disallow: /gifs/ Disallow: /css/ Disallow: /members/ Disallow: /hterror/ Disallow: /hterrors/ # Slow down abusive Yahoo Slurp... User-agent: Slurp Crawl-delay: 360 # http://info.webcrawler.com/mak/projects/robots/exclusion-admin.html