homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

robots.txt used in court case

Msg#: 269 posted 11:56 am on Feb 3, 2004 (gmt 0)


"One of the things presented to the jury was a review of different html codes for Web sites. The eBay Web site html code told robots -- such as BoatRover -- to keep out while YachtWorld.com's code welcomed robots and told them to come back in 30 days, Conwell said."



WebmasterWorld Senior Member pageoneresults us a WebmasterWorld Top Contributor of All Time 10+ Year Member

Msg#: 269 posted 1:27 pm on Feb 3, 2004 (gmt 0)

Interesting story. Based on the quote above, I'd say that the legal team needed an SEM on board to explain to them what is going on.

It sounds like they are referring to the robots.txt file in one instance and then the META revisit tag in another instance. Unfortunately the META revisit tag is not supported by any major SE. In fact, it is specific to one particular SE (SearchBC).

Global Options:
 top home search open messages active posts  

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved