How can I stop them :(

someone with a homemade bot i think. advice ??

[diddlydazz]

I can't use htaccess all I have is a trusty robots.txt but whoever this is, is not using a name ie for me to ban :(

they are hitting me hundreds of times a day but I can't do anything.

I have an IP

Any ideas ??

Dazz

p.s I did ask this before but someone deleted it for some reason.

[gethan]

Dazz - without .htaccess or simalar server functionality your options arn't nice.

1) Redesign your entire site to work through cgi - script to block ips, not a nice option.

2) Phone your hosting provider and get them to block the ip at the router - not likely.

3) Phone your host and get them to give you a .htaccess

4) Change hosts.

Yep I know they all suck ;) Good luck.

[diddlydazz]

Thanks Gethan

I have moved lots of sites already recently from this host so I will have to mocve this one as well shortly so I guess I will just wait.

Thanks

Dazz

[Rugles]

Can you tell us what it looked like.

I have been on a rampage lately and have stopped all un-wanted spiders. Feels real good too!!!!!

So maybe I can help if you tell us who it is.

[diddlydazz]

the IP is cpe-24-221-43-82.az.sprintbbd.net

I have contacted abuse@sprintbbd and asked them to look at it.

It doesn't leave a User-Agent or anything but it follows links like there is no tomorrow.

It has been at one site now for over a month. about 1000 page views a day, which is a serious drain on my bandwidth.

I don't know what it is looking for but it won't find any email addresses, perhaps that is why it keeps coming back :)

If someone can help I would be very grateful.

Thanks

Dazz

[Edge]

Check out this thread [webmasterworld.com...]

[Key_Master]

I can't believe that thread still exists. Heres an improvement:

########################
# Get Browser Agent Info
if ($ENV{'HTTP_USER_AGENT'}) {
$get_agent = $ENV{'HTTP_USER_AGENT'}; # Get Browser Agent
}
else {
$get_agent = $ENV{'REMOTE_HOST'};
}

If the visitor doesn't have an user agent it will give it one (the host name).

[Shane]

So, what I am learning from this is, when checking out a host, look for one of:

1) .htaccess or simalar server functionality

2) a host who will block ips at the router

or,

3) design your entire site to work through cgi - script to block ips.

Are the above in proper priority?

Do hosts grant .htaccess?

[Key_Master]

Get a host that offers both .htaccess modifications and some type of server side scripting (Perl and or PHP). Most hosting companies allow both.

You can ban IPs, agents, etc., using server side scripting or htaccess. I use a combination of both.