Welcome to WebmasterWorld Guest from 220.127.116.11
Forum Moderators: martinibuster
Not posted in this section before, I normally stick to Google and Adsense forums.
I have been having a good look at my sites stats tonightand I think I should be concerned.
Yahoo! Slurp is coming to my site and spidering my site like crazy.
So far this month -
Page Views: 56,566
Bandwidth: 2,715,409 Kb
Is this normal?
The worrying thing is they are taking all my bandwidth. At the going rate they will eat nearly 5 gig.
By a long long long way they are the busiest spider on my site. Google come in at 1,128 visits and MSN at 794 visits so far.
And does anyone know anything more about "OmniExplorer"?
They say on their site ... "Omni-Explorer is a venture-backed startup based in Silicon Valley. Stay tuned to this site; we plan on launching shortly".
Who are they?
Thanks for all replies.
I'm seeing the same thing. I was dropped from Yahoo back in early July. They've been crawling me to the tune of 30,000+ pages daily ever since. (Yes, 30,000 pages daily!) I have multiple dedicated servers, and they're tuned well enough to handle the load. Otherwise, I'd probably have to ban Slurp.
I keep hoping that all of this activity from Slurp is a good sign and that they will eventually reinclude my site. But I'm not showing up at all, even after filing a reinclusion request and after Yahoo's most recent index update. I don't know what to think anymore...
It's as if Yahoo and Google have both gone insane. But I suppose that's a topic for another thread.