homepage Welcome to WebmasterWorld Guest from 54.205.122.62
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
Gigabot Revisited
Pfui

WebmasterWorld Senior Member 5+ Year Member



 
Msg#: 4407737 posted 3:23 pm on Jan 17, 2012 (gmt 0)

This no-referrals bot isn't new. [webmasterworld.com...] [google.com...]

This ignore-robots.txt behavior is:

64.22.106.82 [projecthoneypot.org...]
Gigabot/3.0 (http://www.gigablast.com/spider.html)

01:43:34 /robots.txt [200]
01:43:35 /dir/filename.html/

(Aside: That trailing-slash file URI was denied from the get-go.)

 

dstiles

WebmasterWorld Senior Member dstiles us a WebmasterWorld Top Contributor of All Time 5+ Year Member



 
Msg#: 4407737 posted 10:23 pm on Jan 17, 2012 (gmt 0)

I have that as a banned Global Net Access range (64.22.64.0/18).

Are you sure it's gigabot? That IP has so many open ports (about 400, including internal DOS ports that should never be open), that it's unbelievable! Looks far more like either a new server that's never been set up or a hyperactive botnet (for which I can't recall ever seeing that many open ports!).

keyplyr

WebmasterWorld Senior Member keyplyr us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 4407737 posted 10:31 pm on Jan 17, 2012 (gmt 0)


I haven't allowed it in a long time so I'm not current with it any longer, but if I remember right, Gigabot was highly spoofed a couple years ago.

Pfui

WebmasterWorld Senior Member 5+ Year Member



 
Msg#: 4407737 posted 5:53 am on Jan 18, 2012 (gmt 0)

No clue if it's Gigabot per se or not, sorry.

To me, it doesn't really matter because even the legit one uses data for its company's unnamed partners' purposes, not mine.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved