homepage Welcome to WebmasterWorld Guest from 54.205.168.88
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
powering the semantic web? invention-machine.com
they've been spidering with IP 12.30.60.78
han solo




msg:404828
 4:44 pm on Dec 15, 2000 (gmt 0)

I just wanted to let everyone know about this one, in case you don't have it yet. Their user agent is Mozilla/4.0, so if you look through your logs, best check for the ip.

I noticed in Arin.net that they are using about 60 ips from one c class. Does anyone know if they are spidering from the other ip's or just this one?

The engine they have is cobrain.com, which is pretty interesting, but wouldn't really be one an SEO type like myself would target. So I'm filtering it, and I just thought others might want to as well.

Cheers,
Han Solo

 

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved