homepage Welcome to WebmasterWorld Guest from 54.145.183.169
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
Internetseer, changing tactics.
skirril

10+ Year Member



 
Msg#: 1598 posted 9:10 pm on Jan 14, 2003 (gmt 0)
Just got the following in my log:

pm66.internetseer.net - - [14/Jan/2003:12:03:07 +0100] "HEAD / HTTP/1.1" 200 0 "-" "sitecheck.internetseer.com (For more info see: http://sitecheck.internetseer.com)
66.150.40.70 - - [14/Jan/2003:12:13:53 +0100] "GET /robots.txt HTTP/1.1" 200 427 "-" "sitecheck.internetseer.com (For more info see: http://sitecheck.internetseer.com)"

sitecheck.internetseer.com and internetseer.com are banned in my .htacces, I'll now add 66.150.40.* to that ban.

Skirril

 

Brett_Tabke

WebmasterWorld Administrator brett_tabke us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 1598 posted 10:14 am on Jan 15, 2003 (gmt 0)

Ya, the .net has been around for awhile. Just add the domain name and skip the tld.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved