Welcome to WebmasterWorld Guest from 54.197.116.116

Forum Moderators: martinibuster

Message Too Old, No Replies

First month of New Yahoo search is approaching

Anyone get new stuff indexed without paying yet?

   
11:00 am on Mar 16, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



According to my logs, February 18 was the day Yahoo switched over to their own search. In two days we will celebrate the first month of this changeover.

I've have some pages that Inktomi had never got around to indexing and was hoping for them to show up in the new Yahoo serps. But they're not there yet.

will I have to break down and pay?

Anyone seeing new sites/pages start getting search.yahoo traffic yet, without paying?

mat

11:18 am on Mar 16, 2004 (gmt 0)

10+ Year Member



Nope, not here. Just checked 20 or so pages created post that date - all in G, not one in Y!
12:31 pm on Mar 16, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Just checked a few recent pages that Google finally picked up late last week, none are in Yahoo yet.

Note that this does not surprise me; in the past Google has always picked up new pages much sooner than Ink or alltheweb.

12:35 pm on Mar 16, 2004 (gmt 0)

10+ Year Member



I am still getting Google results in Yahoo for one of my sites.
1:18 pm on Mar 16, 2004 (gmt 0)



Yes - but in a most curious way!

On a test site with only 1 page indexed in the new Yahoo, I set up a script to log all SE spider calls as soon as Yahoo switched.

Over 60 pages (out of 2000) are now indexed. How did they get in there? Not via Slurp!

The only spider to hit me was from FAST - as recently as a few days ago. The only other spider is Googlebot.

Interestingly, these pages currently rank only on exact searches - so they don't appear to be in the main index - but some sort of backfill to the main index. Not with a penalty, because they don't appear last on the exact searches.

But I've checked every page pulled by the FAST spider - and everyone is in there. Those not crawled by it are not.

Something is happening, but I'm not sure what!

3:00 pm on Mar 16, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I saw a lot of those shadow pages show up in Yahoo soon after the switch, makemetop.

I also noticed they rarely get a visitor and if they do, it's on unusual keyword searches. I thought maybe Yahoo was still using Google as backfill, but it is possible they were from Fast.

The shadow pages are included when you make a url query at Yahoo and make it look like all your pages have been indexed. Well, they're in there, but as you say, in a strange sort of way.

The pages that I'm talking about that "in Yahoo" will draw traffic as if they are "in Inktomi".

3:32 pm on Mar 16, 2004 (gmt 0)

10+ Year Member



Interestingly, these pages currently rank only on exact searches - so they don't appear to be in the main index - but some sort of backfill to the main index. Not with a penalty, because they don't appear last on the exact searches.

makemetop, I have some "exact searches" that don't appear last and yet Y! confirmed I got a penalty. So are you sure your theory is correct?

3:59 pm on Mar 16, 2004 (gmt 0)

10+ Year Member



i've got one page indexed that was made after that date. its the site index. the two sub pages that link off it are nowhere yet though.

anyone got any idea of how to check for backlinks on Yahoo, or any other commands?

4:05 pm on Mar 16, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



>backlinks on Yahoo

link:http://www.yourdomain.com

4:07 pm on Mar 16, 2004 (gmt 0)

10+ Year Member



anyone got any idea of how to check for backlinks on Yahoo, or any other commands?

I use site:www.domain.com and found some results but they don't appear on the SERPS except for some weird searches.

Hope this helps.

4:08 pm on Mar 16, 2004 (gmt 0)

10+ Year Member



heh, blindingly obvious really :) for some reason i thought it worked like AtW and just needed the URL

thanks

4:13 pm on Mar 16, 2004 (gmt 0)

10+ Year Member



site:www.domain.com

returns my indexed home page and one other that has been removed from the site for months, that G also lists as a part of my site.

in both cases its in URL format. I guess this is old content preserved from Yahoo using G.

4:14 pm on Mar 16, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Well, I have an penalty, slurp and Fast only reads robots.txt, but when checking more pages from my site, recent pages are in, so that leaves it to Altavista, that still are spidering me.
4:26 pm on Mar 16, 2004 (gmt 0)



>So are you sure your theory is correct?

No!

However, the index page which already was indexed ranks just fine. That usually indicates that there is no penalty.

4:38 pm on Mar 16, 2004 (gmt 0)

10+ Year Member



Question:
What is the proper way to check for the number of pages indexed in the new Yahoo Index?

I have been searching on www.sitename.com, and then selecting the "More Pages From This Site" link alongside the entry for the domain. Is This the Correct way?

When Yahoo first switched to the new Yahoo Index, the "more pages" for my site would display 57 entries. When I did it today it reflects 181, and Yahoo SERPS will display some of the pages that were made last week, when searching for some of the target word phrases.

I have not given Yahoo anything but a submission to the new Add URL option for the free search. (the additional pages were added to the index AFTER I did this, Ink has 26 pages only, after about 7 months)

Thumpcyc

4:50 pm on Mar 16, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Makemetop is right... Ink penalties were often applied to the whole site. I don't think Yahoo has got around to putting sites in the penalty box yet. The penalties, if any, are probably leftover from Inktomi.

If you study your logs, the Ink penalty is identified by having slurp visit (sometimes frequently) the robots.txt file, then leaving.

The shadow pages I'm talking about are likely indexed by Google but not by Inktomi. Because they draw such little search.yahoo traffic, they probably look like penalty pages but those of us that watch our logs don't see slurp making those robot.txt penalty passes at them.

4:51 pm on Mar 16, 2004 (gmt 0)

10+ Year Member



To find pages in the yahoo index search for site:domain.com (no www)

I have launched two sites in the last month, both
index pages show up on Y! but the Y! bot never hit
them. Googlebot did. Then, one day Google dropped
them (everflux) and magically they dropped from Y!
at the same time.

Yahoo is definately still using some Google data.

4:59 pm on Mar 16, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



>If you study your logs, the Ink penalty is identified by having slurp visit (sometimes frequently) the robots.txt file, then leaving.

Yes but as well they passed the penalty to Fast, though Fast only reads the robosfile as well, they ever done that before.

To find pages in the yahoo index search for site:domain.com (no www)

>Actually I donīt think that is correct, though if I do that my penalized index.page comes up.

6:26 pm on Mar 16, 2004 (gmt 0)

10+ Year Member



to check whether your site listed or not in SERPS domain:yourdomain.com site:yourdomain.com give you indexed pages but not guarantee get SERPS in yahoo
8:25 pm on Mar 16, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Have had several sites crawled by either Slurp or Fast & starting to do ok in Y SERPs with old sites with lots of decent links

Is it possible that Fast is acting as Yahoo's Freshbot to the deeper-crawling Slurp?

J