Forum Moderators: open
I've have some pages that Inktomi had never got around to indexing and was hoping for them to show up in the new Yahoo serps. But they're not there yet.
will I have to break down and pay?
Anyone seeing new sites/pages start getting search.yahoo traffic yet, without paying?
On a test site with only 1 page indexed in the new Yahoo, I set up a script to log all SE spider calls as soon as Yahoo switched.
Over 60 pages (out of 2000) are now indexed. How did they get in there? Not via Slurp!
The only spider to hit me was from FAST - as recently as a few days ago. The only other spider is Googlebot.
Interestingly, these pages currently rank only on exact searches - so they don't appear to be in the main index - but some sort of backfill to the main index. Not with a penalty, because they don't appear last on the exact searches.
But I've checked every page pulled by the FAST spider - and everyone is in there. Those not crawled by it are not.
Something is happening, but I'm not sure what!
I also noticed they rarely get a visitor and if they do, it's on unusual keyword searches. I thought maybe Yahoo was still using Google as backfill, but it is possible they were from Fast.
The shadow pages are included when you make a url query at Yahoo and make it look like all your pages have been indexed. Well, they're in there, but as you say, in a strange sort of way.
The pages that I'm talking about that "in Yahoo" will draw traffic as if they are "in Inktomi".
Interestingly, these pages currently rank only on exact searches - so they don't appear to be in the main index - but some sort of backfill to the main index. Not with a penalty, because they don't appear last on the exact searches.
makemetop, I have some "exact searches" that don't appear last and yet Y! confirmed I got a penalty. So are you sure your theory is correct?
No!
However, the index page which already was indexed ranks just fine. That usually indicates that there is no penalty.
I have been searching on www.sitename.com, and then selecting the "More Pages From This Site" link alongside the entry for the domain. Is This the Correct way?
When Yahoo first switched to the new Yahoo Index, the "more pages" for my site would display 57 entries. When I did it today it reflects 181, and Yahoo SERPS will display some of the pages that were made last week, when searching for some of the target word phrases.
I have not given Yahoo anything but a submission to the new Add URL option for the free search. (the additional pages were added to the index AFTER I did this, Ink has 26 pages only, after about 7 months)
Thumpcyc
If you study your logs, the Ink penalty is identified by having slurp visit (sometimes frequently) the robots.txt file, then leaving.
The shadow pages I'm talking about are likely indexed by Google but not by Inktomi. Because they draw such little search.yahoo traffic, they probably look like penalty pages but those of us that watch our logs don't see slurp making those robot.txt penalty passes at them.
I have launched two sites in the last month, both
index pages show up on Y! but the Y! bot never hit
them. Googlebot did. Then, one day Google dropped
them (everflux) and magically they dropped from Y!
at the same time.
Yahoo is definately still using some Google data.
Yes but as well they passed the penalty to Fast, though Fast only reads the robosfile as well, they ever done that before.
To find pages in the yahoo index search for site:domain.com (no www)
>Actually I donīt think that is correct, though if I do that my penalized index.page comes up.