homepage Welcome to WebmasterWorld Guest from 54.225.1.70
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
New 404 test from DIIbot
jimmykav




msg:406032
 8:01 am on Jun 5, 2001 (gmt 0)

Just noticed this new entry in my logs

ip:64.71.132.226
action:GET test404response-1979277706.html
referer:DIIbot/1.2+http://www.findsame.com/robot.html

might be checking for people that always pretend they have the page a spider is looking for?

 

littleman




msg:406033
 6:04 pm on Jun 7, 2001 (gmt 0)

I got a couple thousand of these polluting my logs. It is a waist of bandwidth, and system resources, it would be nice to see them fade away.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved