I installed a translator plugin on one of my WordPress blogs but the plugin wasn't working properly so I disabled it but two days later I found out that my Google web master tools account was reporting about 1100 'Not Found' errors under the 'Web crawl errors' section. All the errors were from … [Read more...] about How to Clean/Remove Not Found Errors from Google web master tools generated from translated versions
How to Control Access of the Web Crawlers or Web Robots to Your Site
There are numerous reasons as to why or when you should control the access of the web robots or web crawlers to your site. As much as you want Googlebot to come to you site, you don't want the spam bots to come and collect private information from your site. Not to mention that when a robot crawls … [Read more...] about How to Control Access of the Web Crawlers or Web Robots to Your Site