homepage Welcome to WebmasterWorld Guest from 54.235.227.60
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Yahoo / Yahoo Search Engine and Directory
Forum Library, Charter, Moderators: martinibuster

Yahoo Search Engine and Directory Forum

    
First month of New Yahoo search is approaching
Anyone get new stuff indexed without paying yet?
mayor




msg:826475
 11:00 am on Mar 16, 2004 (gmt 0)

According to my logs, February 18 was the day Yahoo switched over to their own search. In two days we will celebrate the first month of this changeover.

I've have some pages that Inktomi had never got around to indexing and was hoping for them to show up in the new Yahoo serps. But they're not there yet.

will I have to break down and pay?

Anyone seeing new sites/pages start getting search.yahoo traffic yet, without paying?

 

mat




msg:826476
 11:18 am on Mar 16, 2004 (gmt 0)

Nope, not here. Just checked 20 or so pages created post that date - all in G, not one in Y!

Mohamed_E




msg:826477
 12:31 pm on Mar 16, 2004 (gmt 0)

Just checked a few recent pages that Google finally picked up late last week, none are in Yahoo yet.

Note that this does not surprise me; in the past Google has always picked up new pages much sooner than Ink or alltheweb.

madman21




msg:826478
 12:35 pm on Mar 16, 2004 (gmt 0)

I am still getting Google results in Yahoo for one of my sites.

makemetop




msg:826479
 1:18 pm on Mar 16, 2004 (gmt 0)

Yes - but in a most curious way!

On a test site with only 1 page indexed in the new Yahoo, I set up a script to log all SE spider calls as soon as Yahoo switched.

Over 60 pages (out of 2000) are now indexed. How did they get in there? Not via Slurp!

The only spider to hit me was from FAST - as recently as a few days ago. The only other spider is Googlebot.

Interestingly, these pages currently rank only on exact searches - so they don't appear to be in the main index - but some sort of backfill to the main index. Not with a penalty, because they don't appear last on the exact searches.

But I've checked every page pulled by the FAST spider - and everyone is in there. Those not crawled by it are not.

Something is happening, but I'm not sure what!

mayor




msg:826480
 3:00 pm on Mar 16, 2004 (gmt 0)

I saw a lot of those shadow pages show up in Yahoo soon after the switch, makemetop.

I also noticed they rarely get a visitor and if they do, it's on unusual keyword searches. I thought maybe Yahoo was still using Google as backfill, but it is possible they were from Fast.

The shadow pages are included when you make a url query at Yahoo and make it look like all your pages have been indexed. Well, they're in there, but as you say, in a strange sort of way.

The pages that I'm talking about that "in Yahoo" will draw traffic as if they are "in Inktomi".

eyeinthesky




msg:826481
 3:32 pm on Mar 16, 2004 (gmt 0)

Interestingly, these pages currently rank only on exact searches - so they don't appear to be in the main index - but some sort of backfill to the main index. Not with a penalty, because they don't appear last on the exact searches.

makemetop, I have some "exact searches" that don't appear last and yet Y! confirmed I got a penalty. So are you sure your theory is correct?

stripey




msg:826482
 3:59 pm on Mar 16, 2004 (gmt 0)

i've got one page indexed that was made after that date. its the site index. the two sub pages that link off it are nowhere yet though.

anyone got any idea of how to check for backlinks on Yahoo, or any other commands?

pmac




msg:826483
 4:05 pm on Mar 16, 2004 (gmt 0)

>backlinks on Yahoo

link:http://www.yourdomain.com

eyeinthesky




msg:826484
 4:07 pm on Mar 16, 2004 (gmt 0)

anyone got any idea of how to check for backlinks on Yahoo, or any other commands?

I use site:www.domain.com and found some results but they don't appear on the SERPS except for some weird searches.

Hope this helps.

stripey




msg:826485
 4:08 pm on Mar 16, 2004 (gmt 0)

heh, blindingly obvious really :) for some reason i thought it worked like AtW and just needed the URL

thanks

stripey




msg:826486
 4:13 pm on Mar 16, 2004 (gmt 0)

site:www.domain.com

returns my indexed home page and one other that has been removed from the site for months, that G also lists as a part of my site.

in both cases its in URL format. I guess this is old content preserved from Yahoo using G.

helenp




msg:826487
 4:14 pm on Mar 16, 2004 (gmt 0)

Well, I have an penalty, slurp and Fast only reads robots.txt, but when checking more pages from my site, recent pages are in, so that leaves it to Altavista, that still are spidering me.

makemetop




msg:826488
 4:26 pm on Mar 16, 2004 (gmt 0)

>So are you sure your theory is correct?

No!

However, the index page which already was indexed ranks just fine. That usually indicates that there is no penalty.

thumpcyc




msg:826489
 4:38 pm on Mar 16, 2004 (gmt 0)

Question:
What is the proper way to check for the number of pages indexed in the new Yahoo Index?

I have been searching on www.sitename.com, and then selecting the "More Pages From This Site" link alongside the entry for the domain. Is This the Correct way?

When Yahoo first switched to the new Yahoo Index, the "more pages" for my site would display 57 entries. When I did it today it reflects 181, and Yahoo SERPS will display some of the pages that were made last week, when searching for some of the target word phrases.

I have not given Yahoo anything but a submission to the new Add URL option for the free search. (the additional pages were added to the index AFTER I did this, Ink has 26 pages only, after about 7 months)

Thumpcyc

mayor




msg:826490
 4:50 pm on Mar 16, 2004 (gmt 0)

Makemetop is right... Ink penalties were often applied to the whole site. I don't think Yahoo has got around to putting sites in the penalty box yet. The penalties, if any, are probably leftover from Inktomi.

If you study your logs, the Ink penalty is identified by having slurp visit (sometimes frequently) the robots.txt file, then leaving.

The shadow pages I'm talking about are likely indexed by Google but not by Inktomi. Because they draw such little search.yahoo traffic, they probably look like penalty pages but those of us that watch our logs don't see slurp making those robot.txt penalty passes at them.

farside847




msg:826491
 4:51 pm on Mar 16, 2004 (gmt 0)

To find pages in the yahoo index search for site:domain.com (no www)

I have launched two sites in the last month, both
index pages show up on Y! but the Y! bot never hit
them. Googlebot did. Then, one day Google dropped
them (everflux) and magically they dropped from Y!
at the same time.

Yahoo is definately still using some Google data.

helenp




msg:826492
 4:59 pm on Mar 16, 2004 (gmt 0)

>If you study your logs, the Ink penalty is identified by having slurp visit (sometimes frequently) the robots.txt file, then leaving.

Yes but as well they passed the penalty to Fast, though Fast only reads the robosfile as well, they ever done that before.

To find pages in the yahoo index search for site:domain.com (no www)

>Actually I donīt think that is correct, though if I do that my penalized index.page comes up.

kenari




msg:826493
 6:26 pm on Mar 16, 2004 (gmt 0)

to check whether your site listed or not in SERPS domain:yourdomain.com site:yourdomain.com give you indexed pages but not guarantee get SERPS in yahoo

johnser




msg:826494
 8:25 pm on Mar 16, 2004 (gmt 0)

Have had several sites crawled by either Slurp or Fast & starting to do ok in Y SERPs with old sites with lots of decent links

Is it possible that Fast is acting as Yahoo's Freshbot to the deeper-crawling Slurp?

J

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Yahoo / Yahoo Search Engine and Directory
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved