BOTW Spider - Crawler, Spider, and User Agent ID forum at WebmasterWorld - WebmasterWorld

Forum Moderators: open

Message Too Old, No Replies

BOTW Spider

Mokita

3:56 am on Jan 7, 2007 (gmt 0)

10+ Year Member

Only asked for default home page but didn't ask for robots.txt.

Full UA:
Mozilla/4.0 (compatible; BOTW Spider; +http://botw.org)

IP: 209.11.177.nnn

jdMorgan

12:13 am on Jan 10, 2007 (gmt 0)

WebmasterWorld Senior Member

10+ Year Member

Best of The Web directory page verifier, IIRC.

Jim