Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- How can I block strange URL's?


IndigoHollow - 2:21 pm on Nov 13, 2012 (gmt 0)


On my site search bots are often index URL's like:

/statji/raschet-dimoudalenija?PAGEN_1=3
/statji/raschet-dimoudalenija?PAGEN_1=2
/statji/raschet-dimoudalenija?undefigned

but there is no such URL's on my site. There is only:

/statji/raschet-dimoudalenija

it's a page with my text article.

Question: how can I block those strange URL's? Don't want to write them all in robots.txt.


Thread source:: http://www.webmasterworld.com/robots_txt/4518731.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com