New robots.txt Tester Launches in Google Webmaster Tools

The robots.txt testing tool in Google Webmaster Tools has just received an update to highlight errors causing Google not to crawl pages on your website, let you edit your file, test if URLs are blocked, and let you view older versions of your file.

If Google isn’t crawling a page or section of your website, the robots.txt tester, located under the Crawl section of Google Webmaster Tools, will nowadays let you examine whether there’s an issue in your file that’s blocking Google. (This part of GWT used to be known as Blocked URLs.)

Thu smo news

For more information CLICK

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong>