Comments on: How to Clean/Remove Not Found Errors from Google web master tools generated from translated versions

By: Miniclip

Miniclip — Tue, 03 Jan 2012 08:37:15 +0000

thanks a lot… you save me from this annoying not found errors..

By: admin

admin — Fri, 28 Oct 2011 21:59:55 +0000

If you use the Google webmaster tool it will only affect Google. The robot.txt is helpful for all search engine bots.

By: Hezy

Hezy — Fri, 28 Oct 2011 08:40:26 +0000

Hi, thanks for this great tutorial. Is there any difference if I use robot.txt file for removing pages from index instead of using webmaster tools?

By: dualsim

dualsim — Wed, 14 Sep 2011 11:30:57 +0000

thanks for your post its helpful…..

By: Jack

Jack — Tue, 13 Sep 2011 02:59:22 +0000

Thank you for sharing. That’s good for me.

By: New Movie Download

New Movie Download — Mon, 22 Aug 2011 18:21:21 +0000

i face this problem & this tips is so helpful for me.
thanks a lot.

By: nike air max store

nike air max store — Sat, 09 Apr 2011 09:34:47 +0000

Thanks for your sharing the information!

By: NikeShoesClearance

NikeShoesClearance — Thu, 24 Mar 2011 03:49:24 +0000

Good share, thanks a lot

By: replica orologi

replica orologi — Wed, 16 Mar 2011 05:14:14 +0000

Thanks for your sharing.They are very useful.

By: admin

admin — Sun, 20 Feb 2011 02:56:14 +0000

@Watson, I have cleaned up the code a bit in this post. asterisk (*) is a wild card witch mean everything under that directory. So you are telling the bots that ignore everything under that language directory.

Yes, it is important to have the following two lines in the robots.txt file as the first line says who this rule applies to (again asterisk mean everyone) and the 2nd line is saying allow access to everything else under the root (it won’t access the stuff that you specified in the disallow command)

User-Agent: *
Allow: /