I'm seeing yahoo fetching 60 pages a second here, i've never seen them crawl anywhere near this depth.
markus007
7:01 am on Dec 13, 2004 (gmt 0)
200,000 pages in the last 11 hours.
fiestagirl
3:23 pm on Dec 13, 2004 (gmt 0)
Is it slurp or one of the others?
HarryM
4:17 pm on Dec 13, 2004 (gmt 0)
I only get my logs and stats once per week, the last ones ending on midnight on 11 Dec, so I don't yet know what happened afterwards. But whereas Slurp normally takes only about 25% of my pages weekly, last week it took about 200%, mainly on the 11th.
markus007
5:01 pm on Dec 13, 2004 (gmt 0)
its going nuts.... fetched my homepage 319 times yesterday... hmmm
Yahoo! trying to copy Google? Saw the same a couple of weeks ago with GB. But Markus you're right, it's weird, I see the same.
abates
11:59 pm on Dec 13, 2004 (gmt 0)
Maybe they're crawling to get all the 301 redirects. I noticed on the Yahoo! search blog the other say that they said they had finally sorted these out...
sasha
4:44 am on Dec 15, 2004 (gmt 0)
It's crawled and recrawled my site (60,000 pages) several times since early Nov. I am yet to see any of those pages appear in their index. What gives?
