Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- robots.txt need help


a4tech - 5:03 pm on Jan 11, 2013 (gmt 0)


Hello.

I need help. I see that google crowl some bad links that does not exist in my website.

like

http://example.com/test%p%12%5%.html

I am wanted to block that the urls that contain %.

If i Add in my Robot file:

Disallow: %

will this work perfectly or it will disterb other web urls that does not contain %.

Please give your suggestion and feed back.

Thanks a lot.


Thread source:: http://www.webmasterworld.com/robots_txt/4535330.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com