# Robots.txt file from http://www.searchengineworld.com # # Built from text file # # This restricts access to only known and registered robots. # User-agent: Mozilla/3.0 (compatible;miner;mailto:miner@miner.com.br) Disallow: User-agent: METAGOPHER Disallow: User-agent: Googlebot/2.X (+http://www.googlebot.com/bot.html) Disallow: User-agent: * Disallow: