homepage Welcome to WebmasterWorld Guest from 54.227.62.141
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
robots.txt used in court case
transactiongeek




msg:1525511
 11:56 am on Feb 3, 2004 (gmt 0)

[tampabay.bizjournals.com...]

"One of the things presented to the jury was a review of different html codes for Web sites. The eBay Web site html code told robots -- such as BoatRover -- to keep out while YachtWorld.com's code welcomed robots and told them to come back in 30 days, Conwell said."

 

pageoneresults




msg:1525512
 1:27 pm on Feb 3, 2004 (gmt 0)

Interesting story. Based on the quote above, I'd say that the legal team needed an SEM on board to explain to them what is going on.

It sounds like they are referring to the robots.txt file in one instance and then the META revisit tag in another instance. Unfortunately the META revisit tag is not supported by any major SE. In fact, it is specific to one particular SE (SearchBC).

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved