Robots.txt Generator Default – All Robots are: Allowed Refused Search Robots: Google Google Image Google Mobile MSN Search Yahoo Yahoo MM Yahoo Blogs Ask/Teoma GigaBlast DMOZ Checker Nutch Alexa/Wayback Baidu Naver MSN PicSearch Crawl-Delay: 5 sec 10 sec 20 sec 40 sec 60 sec 120 sec Sitemap: Generate Robots.txt Copy Robots.txt Download Robots.txt
