homepage Welcome to WebmasterWorld Guest from 54.227.141.230
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Pubcon Website
Visit PubCon.com
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
Gigabot Revisited
Pfui




msg:4407739
 3:23 pm on Jan 17, 2012 (gmt 0)

This no-referrals bot isn't new. [webmasterworld.com...] [google.com...]

This ignore-robots.txt behavior is:

64.22.106.82 [projecthoneypot.org...]
Gigabot/3.0 (http://www.gigablast.com/spider.html)

01:43:34 /robots.txt [200]
01:43:35 /dir/filename.html/

(Aside: That trailing-slash file URI was denied from the get-go.)

 

dstiles




msg:4407941
 10:23 pm on Jan 17, 2012 (gmt 0)

I have that as a banned Global Net Access range (64.22.64.0/18).

Are you sure it's gigabot? That IP has so many open ports (about 400, including internal DOS ports that should never be open), that it's unbelievable! Looks far more like either a new server that's never been set up or a hyperactive botnet (for which I can't recall ever seeing that many open ports!).

keyplyr




msg:4407944
 10:31 pm on Jan 17, 2012 (gmt 0)


I haven't allowed it in a long time so I'm not current with it any longer, but if I remember right, Gigabot was highly spoofed a couple years ago.

Pfui




msg:4408013
 5:53 am on Jan 18, 2012 (gmt 0)

No clue if it's Gigabot per se or not, sorry.

To me, it doesn't really matter because even the legit one uses data for its company's unnamed partners' purposes, not mine.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved