The main difference between the standard and professional edition is the ability to analyze your log files for search engine spider, robot, and crawler visits. The standard edition only allows creating and maintaining a robots.txt file.
| Features |
Standard |
Professional |
Creating robots.txt Files |
 Automatically creates correctly formatted, industry standard Robot Exclusion Files in real-time |
 |
|
| Uploads the robots.txt file to your web server |
|
|
| Allows you to manually edit the robots.txt file and export those changes |
|
|
| Allows grouping of spiders with similar attributes for smaller robots.txt files |
|
|
| Reads your web site structure either locally or from the web server |
|
|
| Database of most major US and international spider user-agent identifiers |
|
|
| Allows you to Add, Edit, and Delete your own spiders |
|
|
| Can be used in some situations to direct search engine spiders to optimized pages |
|
|
| Easy-to-learn-and-use step-by-step user interface with Quick Help |
|
|
| Analyzing Log Files |
| Uses log file analysis to detect spider visits and pages indexed |
|
|
| Informative reports showing spider visits and pages indexed by month, plus a logical tree view to show relationships |
|
|
| Whois dialog box for looking up the owners of host names and ip addresses |
|
|
| Builtin editor for adding spiders that don't normally request the robots.txt file |
|
|
| Support for Windows, Linux (Unix), and Mac ftp servers |
|
|
| Indicates visually the pages requested by spiders in error (i.e., 404 Not Found) |
|
|
| Can access log files locally or download them from web servers |
|
|
| Telnet to the web server and extract spider visits directly from the server |
|
|
| Can add any new spiders found on your web site to Robot-Manager |
|
|
| Exports spider and page visits to both CSV (Comma Separated Values) and XML formats |
|
|
| Exports raw log entries of just spider visits |
|
|
| Exports all spider IP addresses so they can be used by cloaking software |
|
|
| Commandline options for running multiple projects unattended |
|
|
| Provides log file analysis for muliple log files at the same time |
|
|
| Support for compressed log files (both Windows and Linux) |
|
|
| Auto detects your log file format, and in the rare case where it can't, you can specifiy the format manually |
|
|
