Welcome to WebmasterWorld Guest from

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

Hit Hard 876 reqs in 42 min




1:03 pm on May 28, 2001 (gmt 0)

10+ Year Member

This really ticked me off when I saw it. :o Luckily the power went off for an hour so I could chill.

Anyway, I think this might be some one running their own personal bot but I'm not sure. They entered the site by following a link from an se. Then they made 876 requests, 843 of which were for pages in 42 minutes. They did not request robots.txt The site itself only has about 120 pages so they requested the same files many, many times.

If anyone has any info on this I'd really appreciate it. :)

UA:Mozilla/4.76 [en]C-gatewaynet (Win95; U)
But for most of the requests, they left the ua blank.


8:13 am on May 29, 2001 (gmt 0)

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month


That an isp customer. Looks like joe user is just spidering you for data.


2:18 am on May 30, 2001 (gmt 0)

10+ Year Member

Thanks for the info Brett :)

I hope joe user slows down his bot and teaches it to know when it already downloaded a page before he comes back again.


Featured Threads

Hot Threads This Week

Hot Threads This Month