• worth test
  • Support
  • Robots.txt Generator


    Default - All Robots are:  
        
    Crawl-Delay:
        
    Sitemap: (leave blank if you don't have) 
         
    Search Robots: Google
      Google Image
      Google Mobile
      MSN Search
      Yahoo
      Yahoo MM
      Yahoo Blogs
      Ask/Teoma
      GigaBlast
      DMOZ Checker
      Nutch
      Alexa/Wayback
      Baidu
      Naver
      MSN PicSearch
       
    Restricted Directories: The path is relative to root and must contain a trailing slash "/"
     
     
     
     
     
     
       



    Now, Create 'robots.txt' file at your root directory. Copy above text and paste into the text file.


    About Robots.txt Generator

    Site SEO Tools provide Robots.txt Generator which generates useful robots.txt files that assist to know that search engines are indexing your website.