Robots.txt Generator Tool Default for All Robots Allowed Refused Crawl Delay None 5 Seconds 10 Seconds 20 Seconds 60 Seconds 120 Seconds Sitemap Google Allowed Refused Google Images Allowed Refused Google Mobile Allowed Refused MSN Search Allowed Refused Yahoo Allowed Refused Yahoo MM Allowed Refused Yahoo Blogs Allowed Refused Ask/Teeoma Allowed Refused GigaBlast Allowed Refused DMOZ Checker Allowed Refused Nutch Allowed Refused Alexa / Wayback Allowed Refused Baidu Allowed Refused Naver Allowed Refused MSN PicSearch Allowed Refused Disallowed Directories Generate Robots.txt Copy