Welcome to WebmasterWorld Guest from

Forum Moderators: martinibuster

Message Too Old, No Replies

Is Google spidering creating a bandwidth issue for you?

AdSense spidering

3:04 am on Jul 27, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Mar 14, 2003
votes: 0

Between Google and Inktomi my server is getting spidered like crazy. I was wondering if anyone else is seeing a lot of spidering and how it is affecting your server performance.

[edited by: beggers at 5:33 am (utc) on July 27, 2003]

5:05 am on July 27, 2003 (gmt 0)

Full Member

10+ Year Member

joined:May 21, 2003
votes: 0

Yeah, I'm just getting spidered like crazy. I typically serve up 3,000 pageviews a day, but my logs have been 7,000 a day or even more. The spiders are just grinding through my site non-stop: Google, Teoma, Inktomi, and some I don't recognize. Google's definitely coming by once a day.

I haven't checked to see what percentage is from Adsense, though.


Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members