Welcome to WebmasterWorld Guest from 23.22.220.37

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

lynx robot

too much information?

     
4:14 am on Jul 15, 2012 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time Top Contributors Of The Month

joined:Apr 9, 2011
posts:12696
votes: 244


Query: If I didn't have external evidence*, would it be obvious that this is a robot?

Lynx/2.8.5rel.1 libwww-FM/2.14FC SSL-MM/1.4.1b OpenSSL/0.9.7d-dev

For comparison purposes I visited the same page myself in Lynx and checked the log. It says only

Lynx/2.8.6rel.5 libwww-FM/2.14

Is this one of those stereotypical police scenarios where you sit back and let them hang themselves? It should have stopped at 2.14FC :) (Interesting that real Lynx doesn't send any information about computer or OS. Never knew that.)


* It visited the same page twice, almost concurrently-- within the same second in logs-- using two different referers. I will concede, Don, that this is as close to physically impossible as you can get. And then proceeded to the home page in less time than it would have taken a human to find or type the link.
5:18 am on July 15, 2012 (gmt 0)

Administrator from US 

WebmasterWorld Administrator incredibill is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Jan 25, 2005
posts:14622
votes: 86


Just because it might be the real Lynx doesn't mean it's not being driven to read pages by a bot script, pretty clever really.

[edited by: incrediBILL at 5:55 am (utc) on Jul 15, 2012]

5:53 am on July 15, 2012 (gmt 0)

Senior Member

WebmasterWorld Senior Member wilderness is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Nov 11, 2001
posts:5408
votes: 2


lucy,
There's an online tool that generates that UA.
Anybody may use.

Lynx Viewer [delorie.com]

The intent is to see the underlying-HTML in the same manner that bots do.

I use to use the thing on my own sites frequently some years back, however had the UA denied when I wasn't using it.
5:59 am on July 15, 2012 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 26, 2001
posts:5800
votes: 64



Ha, that tool doesn't work for my sites.