Robots.txt Syntax Checker
http://www.sxw.org.uk/computing/robots/check.html Online tool for syntax verification to robots.txt files, provided by Simon Wilkinson. Robots.txt syntax checker Writing robots.txt files is relatively straightforward. However, its still fairly common to get some small part of the syntax wrong, and then to find that a robot has wandered all over your site because of it. This robots.txt syntax checker checks the contents of awaiting for hand_moderation Authoring > Online Tools > robots.txt Robots txt syntax checker
Write a Review
Add to My Favorite
Refer it to Friend
Report Broken Link
Google Ads
Other links at Authoring > Online Tools > robots.txt
Information on the use of robots.txt as well as a robots.txt generator and a list of search engine robots.
Category:
Online tool for syntax verification to robots.txt files, provided by Simon Wilkinson.
Category:
Analyzes a robots.txt file searching for syntax and "logical" errors, and shows a summary of what effect it will have.
Category:
Tool that fetches robots.txt from a given URL and parses it against the URL. Includes different user-agents.
Category:
Robots.txt generator designed for public use. Includes tutorial.
Category:
Main Category
143
302
42
2
9188
87
636
2020
15
26
1598
88
72
Pagerank Statistics
Directory Statistics
Links: 14217
Categories: 368
Yahoo! News
Top 10
