Robots.txt Review and Download
The most trusted software reviews since 2003
  Follow Us on Twitter
  • Login
  • Register
  • ProjectBeta » Software Downloads » Web Authoring » Site Management Software » Download Robots.txt

    Robots.txt 2.0 Review and Download

    Robots.txt is a visual editor for Robot Exclusion Files and a log analyzer software. Easily and quickly, it allows a user to create the robots.txt files required to instruct search engine spiders, which parts of a Web site are not to be indexed and made searchable by the general Web public and then to identify spiders, which do not keep to those instructions. The program provides the user a way to log onto his FTP or local network server and then select the documents and directories which are not to be made searchable.

    By means of this program you will be able to visually generate industry standard robots.txt files; identify malicious and unwanted spiders and ban them from your site; direct search engine crawlers to the appropriate pages for multilingual sites; use robots.txt files for doorway page management; keep spiders out of sensitive and private areas of your Web site; upload the correctly formatted robots.txt files directly to your FTP server not switching from Robots.txt Editor; track spider visits; create spider visits reports in HTML, Microsoft Excel CSV and XML formats and more.

    

    WindowsOperating System

    Windows 2000, XP, 2003, Vista, 7, 8

    Robots.txt Review

    Have you ever used Robots.txt? Then post your short opinion and let everyone know what are its main pros and cons.

    Not sure what to write about? Check out other user reviews below!





    Reviews

    No Reviews Yet



    Currently, there are no Robots.txt reviews. If you have ever used this tool, be the first to post your feedback and earn money that can be used to get full licenses of desired games and software.

    Changelog

    Version 2.0 Changelog (Updated on August 18, 2006)

    Small tweaks for better performance
    Minor improvements
    Bug fixes

    More Recommended Tools from NetPromoter

    We have 7 more great tool(s) published by NetPromoter. Check them out!

    NetPromoter
    Report Problem

    Report Problem

    If you experience any problems with Robots.txt download, or you believe that some information on this page is incorrect, use the form below to notify ProjectBeta editors, so they can contact NetPromoter and update the listing with up-to-date information.




    Top