Gigabot is starting to be really annoying

Getting shed of Gigabot

[docwebstr]

Realize you're talking to an utter newbie and babe in the woods when it comes to this stuff.

So. I run snipped and Gigabot (or at least some bot at the 64.62.168.* ip range) is slamming the bejeezus out of my Gothic request page. I've done a robots.txt for Gigabot disallowing the given page, but it just keeps coming back to that exact same page and, unfortunately, apparently hitting the links to make the songs requests. How can I get it to knock it off?

[edited by: DaveAtIFG at 10:53 pm (utc) on Aug. 7, 2004]
[edit reason] URL removed [/edit]

[trillianjedi]

You need to take your URL out of your post as per this sites TOS.

Just ban the bots IP range in your htaccess file.

TJ

[docwebstr]

Well, I'm certainly trying to delete the URL but I can't seem to find the edit button. Sorry for sounding like such an utter dork.

[stef25]

there should be an owner edit button under your profile and sticking mail icons to the left of all msgs you post

[trillianjedi]

there should be an owner edit button

It times out.

TJ

[docwebstr]

Sorry, folks. I'd have edited it if I could. I'll know from now on.

[docwebstr]

Gigablast's bot is back after a couple days of relative peace and is apparently ignoring the robots.txt and all efforts to use DenyIP. To make matters worse, now Inktomisearch.com's bots are in on it.

[PatrickDeese]

Are you sure your robots.txt is being parsed correctly?

Also, could it be someone who is spoofing the useragent - like a site downloading program.

[docwebstr]

I had it checked out from a couple different validators. *shrug*

It could be a site downloader, but it'd have to be a hell of a slow site downloader as this went on for hours on end on Thursday and from several different IPs.