Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Editing Robots.txt to block parameters


spina45 - 6:24 pm on Mar 15, 2011 (gmt 0)


Is there any syntax to disallow all URLs that (mistakenly) have double slashes like this: www.domain.com/catagory//productname.html ?

I was trying add a slash at the end of: category and mistakenly added two just as Googlebot came by. The // has been corrected but I'd like Google to stop looking for it.


Thread source:: http://www.webmasterworld.com/robots_txt/4235296.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com