Forum Moderators: DixonJones
I'm guessing that this is in response to the recent shake-ups in the search provider world -- With Fast's recent sale of AllTheWeb to Overture/Yahoo!, and Fast's apparently-sole focus on enterprise search, Lycos may now have to re-develop their own search index.
Anyway, the first log entry was:
209.202.2**.* - - [27/Feb/2004:23:14:55 -0600] "GET /robots.txt HTTP/1.0" 200 2335 "-" "Lycos_Spider_(modspider)"
Jim
<added> And no, I don't know how to make sense of this in light of recent Lycos news: [webmasterworld.com...] </added>
Looks like an existing ban is in place.
What with all these new and or re-'mastered' bots coming around it might be prudent for folks to check traps and re-evaluate bans.
Congrats on going over four too Jim. Excellent work. :)