Forum Moderators: open

Message Too Old, No Replies

Gigabot IP address?

         

keyplyr

10:54 pm on Jul 2, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Anyone seen Gigabot comming from?

38.114.104.53 - - [02/Jul/2007:00:05:55 -0400] "GET /webpage.html HTTP/1.0" 200 10782 "-" "Gigabot/3.0 (http://www.gigablast.com/spider.html)"

volatilegx

8:03 pm on Jul 3, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



New to me.

jdMorgan

8:27 pm on Jul 3, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Saw that today, too. Unfortunately, that IP does not resolve back to GigaBlast because the reverse DNS is not set up properly. However, if you do a tracert using that IP address, the IP address of the last 'hop' before reaching it *does* resolve to GigaBlast.

So, GigaBot got blocked on my site for several hours, until I spotted the 403 responses and tracked down its missing rDNS.

[added]
Also got requests from
38.114.104.88 and 38.114.104.102

So from the small sample in this thread, it looks like a CIDR of 38.114.104.0/25 (38.114.104. 0 - 128) covers this new range.
[/added]

Jim

[edited by: jdMorgan at 9:01 pm (utc) on July 3, 2007]

keyplyr

11:05 pm on Jul 3, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Thanks Jim

Nowadays I spend more and more time working defensively. Gone are the "good ol' days" of just creating great websites.

jdMorgan

11:50 pm on Jul 3, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Just to be clear, I block a lot of the 38.0.0.0/8 range, but I do allow GigaBot from GigaBlast.com itself, so the CIDR posted above is a "hole" I added in the blocked 38.0.0.0/8 range to allow it.

Jim

wilderness

12:29 am on Jul 4, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



You dirty bugger Jim ;)

BTW, guess I should fess up ;)

deny from 38.

keyplyr

9:05 pm on Jul 4, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



So from the small sample in this thread, it looks like a CIDR of 38.114.104.0/25 (38.114.104. 0 - 128) covers this new range - jdMorgan

Just had it come from 38.114.104.150

jdMorgan

11:43 pm on Jul 4, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



So now we're up to a /24 CIDR, assuming it's defined as one contiguous block...

I'd say GigaBot is getting popular if it needs 256 addresses to spider form -- Someone's paying the bill... :)

Jim