- - Search Engines
- -- Sitemaps, Meta Data, and robots.txt
- ---- In the era of increasing numbers of bad bots is robots.txt irrelevant?
Kirby - 4:53 pm on Feb 20, 2006 (gmt 0)
Bill, can this be done effectively on a Win platform (.NET)?
Thread source: http://www.webmasterworld.com/robots_txt/871.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com