Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- robots.txt used in court case


transactiongeek - 11:56 am on Feb 3, 2004 (gmt 0)


[tampabay.bizjournals.com...]

"One of the things presented to the jury was a review of different html codes for Web sites. The eBay Web site html code told robots -- such as BoatRover -- to keep out while YachtWorld.com's code welcomed robots and told them to come back in 30 days, Conwell said."


Thread source:: http://www.webmasterworld.com/robots_txt/269.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com