Welcome to WebmasterWorld Guest from

Forum Moderators: Ocean10000 & incrediBILL & keyplyr

Message Too Old, No Replies

Hit Hard 876 reqs in 42 min


1:03 pm on May 28, 2001 (gmt 0)

Junior Member

10+ Year Member

joined:Mar 1, 2001
votes: 0

This really ticked me off when I saw it. :o Luckily the power went off for an hour so I could chill.

Anyway, I think this might be some one running their own personal bot but I'm not sure. They entered the site by following a link from an se. Then they made 876 requests, 843 of which were for pages in 42 minutes. They did not request robots.txt The site itself only has about 120 pages so they requested the same files many, many times.

If anyone has any info on this I'd really appreciate it. :)

UA:Mozilla/4.76 [en]C-gatewaynet (Win95; U)
But for most of the requests, they left the ua blank.

8:13 am on May 29, 2001 (gmt 0)

Administrator from US 

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 21, 1999
votes: 28


That an isp customer. Looks like joe user is just spidering you for data.

2:18 am on May 30, 2001 (gmt 0)

Junior Member

10+ Year Member

joined:Mar 1, 2001
votes: 0

Thanks for the info Brett :)

I hope joe user slows down his bot and teaches it to know when it already downloaded a page before he comes back again.


Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members