Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

robots.txt used in court case



11:56 am on Feb 3, 2004 (gmt 0)


"One of the things presented to the jury was a review of different html codes for Web sites. The eBay Web site html code told robots -- such as BoatRover -- to keep out while YachtWorld.com's code welcomed robots and told them to come back in 30 days, Conwell said."


1:27 pm on Feb 3, 2004 (gmt 0)

WebmasterWorld Senior Member pageoneresults is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

Interesting story. Based on the quote above, I'd say that the legal team needed an SEM on board to explain to them what is going on.

It sounds like they are referring to the robots.txt file in one instance and then the META revisit tag in another instance. Unfortunately the META revisit tag is not supported by any major SE. In fact, it is specific to one particular SE (SearchBC).


Featured Threads

Hot Threads This Week

Hot Threads This Month