| Welcome to WebmasterWorld Guest from 22.214.171.124 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Pubcon Platinum Sponsor 2014|
| 3:10 am on Aug 6, 2003 (gmt 0)|
Anyone come across this one?
| 10:06 pm on Aug 6, 2003 (gmt 0)|
Your likely to see any thing from Road Runner :(
The bot is the SE address. There doesn't appear to be much there.
| 9:09 am on Aug 7, 2003 (gmt 0)|
I first noticed this spider on august 3rd, according to my logs doesn't even look for a robots.txt file.
Their site has no real info whatsoever, let alone regarding their spider, so I blocked it.
| 5:42 pm on Aug 8, 2003 (gmt 0)|
It checked robots.txt on my site and didn't take anything else.
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved