My site's index page is regularly visited by both Yahoo Slurp and the Overture Crawler at AllTheWeb.com. (Every 4-5 days). Are these two crawlers feeding to different Indexes?
Thanks SDani
Yahoo_Mike
6:03 pm on May 10, 2004 (gmt 0)
No, while they may appear to be separate, they're actually feeding the same Yahoo index.
sdani
10:44 am on May 11, 2004 (gmt 0)
Thanks a lot for the response Mike.
Best SDani
shahid
12:56 pm on May 11, 2004 (gmt 0)
But while yahoo shows most of pages of my site, alltheweb still shows only two pages.
helenp
12:06 pm on May 15, 2004 (gmt 0)
yahoo Mike: <<<<No, while they may appear to be separate, they're actually feeding the same Yahoo index. >>>>
Is Scooter as well for Yahoo index?
MikeBeverley
8:13 am on May 24, 2004 (gmt 0)
I haven't seen scooter for a while now, I thought he was dead. Is anyone still seeing him?
helenp
8:18 am on May 24, 2004 (gmt 0)
It came in to my site 14/5 and hasnīt been back, strange got the robots.txt an 404 for an page took away, and an 206 for an existing page.
Expected it to be back though scooter always been very hungry.
