I have the same problem on a couple of my sites. I can see Slurp picking up pages in my server logs, but the pages it grabs don't turn up in the index. If I link temporarily to one of the pages from another site (different subdomain) the page appears in the index, but disappears again after a while.
Google's indexing them happily, of course.
Yahoo does have a free submission page. You can submit to Yahoo for free and wait 1 or 2 months and it might get picked up. No guarantees. However, if you want guranateed inclusion, you can pay to get in with the Yahoo Sitematch program. It costs $49 for first URL, $29 for 2-10 and $10 for 11+. There are also CPC charges at 15 or 30 cents a click, depending on your category.
I am afraid that Yahoo! is just patheticly slow at picking up new sites and content.
I too have a new site (which I started only because Yahoo! dropped the other one for some reason)..anyway.. it too has a 40 or so good back links form other (Yahoo! indexed) sites.
Yahoo! got the index page but just does not bother with the rest.
Just to add insult to injury I have all robots blocked except Yahoo! but most of the other search engines visit at least daily and Google (even though it repects the robots.txt) knows all about the site and all the back links to it...
As I said Yahoo! indexing is pathetically slow ...what a pain in the "ии$ Yahoo! is these days..really.
Submitx: The freeadd url takes days not weeks or months assuming that the content that is submitted is of sufficient quality.
Sadly Y! does seem to be slow in updating content though. My site is 2 years old, been in the index for ages, but page content not been updated for at least a month. As comparison, G is displaying updated/new content within 48hrs. I really like to new Y! .com interface though, hope it comes to the .uk soon!
I have the same problem with a small special-interest site that is two years old. Slurp spidered it regularly up to the end of September and hasn't been seen since. I submitted it to Yahoo some time in the summer. Despite all this, neither Yahoo nor (Ink-based) MSN has ever listed it, even in searches for the domain name. Searching for the domain shows 18 results in Yahoo, all linking to the site, including its DMOZ listing.
The site is small (about 35 pages) and gets a small but steady stream of well-targeted traffic from Google. The new MSN has it thoroughly indexed.
I realise this is an Ink issue, rather than a Yahoo one, but I'd be interested to hear any ideas on why it's being ignored.
In my experience if Y! likes your site they are faster at adding pages/new content than Google 1-2 days.
If they don't like your site it can take months.
Is Yahoo currently testing a new algo on the live results?
We are always running many tests simultaneously figuring out how users react to changes we make to the Yahoo search experience.
There is a search blog posting written about our search testing posted on 9/28/04.
My site was doing very good with Yahoo until 3 months ago when I got kicked out from Yahoo for whatever reason. What service would you suggest to get back being indexed, even my home page which has over 800 Yahoo backwards links doesn't exist to yahoo/msn. I do not want to base on CPC, just being indexed would be great. Thanks for your help.
TomekLawreszuk: so when you type your URL or company name you are nowhere to be found? If so, then there might be a reason you are not listed. Some POssible reasons:
- You are penalized
- You have another domain, either with duplicate content or on the same host.
- Your site was down when it was spidered
Paying for SiteMatch to get in might resolve the situation. However, after getting in, if you still don't rank for any keywords, then you are definitely penalized.
How long does it take fur new URLs to appear in SERPS?
We were spidered by slurp about 10 days ago quite aggressively, but to date no new URLs appear in domain:mysite.com command.
Seeing a modest update today.
Can report that now 3 pages apart from my site apart from the the index page are now in the index.
Progress I suppose after three months.
Still waiting for the other 90% of the pages..
Seeing a MAJOR drop out for my site:
Until yesterday my site hovered between Pos#2 and #3 for two keywords (2 million results). Today my site is gone from SERPs. 150+ pages are still indexed (that has not changed). Also backlinks dropped from 2100 to 1500 but that is way ahead of competitors.
Site still is in the Y! directory.
I registered in SiteMatch in March 2004. I stopped adding funds end of September. Site still hovered between 2-3 in SERPS. Could there be some penalty now for not funding account?
I don't have another domain, either with duplicate content or on the same host.
The site is hosted by Pair and their servers are usually very reliable - could our site have been down when it was spidered - perhaps - I don't have a good way to check this. The home page is still cached and content looks recent (within last two weeks).
Sounds like you may have a ban, although you wont know for sure for six weeks or so the site may pop back.
I have had two sites banned. One I used positiontech for (years ago) and the other one not. So I don't really follow the sitematch postion tech arguments of some others here, rather I believe the bans are given for a number of reasons best known to the Yahoo! staff. The reasons are probably as numerous as their editors.
I hope you site comes back soon.
[Submitx: The freeadd url takes days not weeks or months assuming that the content that is submitted is of sufficient quality.
Thanks, Tim ]
Perhaps someone may be able to throw some light on this oddity?
If Yahoo are still listing old URL's for previously discarded sites and still not following 301 redirects correctly (Tim mentioned that this was a priority in March 2004) how can replacement/updated - sites/pages be listed correctly?
We are still witnessing sites included in Yahoo that:
1. Contain a robots.txt banning all bots
2. Contain robots exclusion tags in every page.
An old site belonging to a client that has been subject to the above for over 6 months (including at one time a 301 redirect) is still listed in Yahoo Search results.
When searching using the company name the old url listing appears first with only:
1. the url
2. more pages link - of which there are none!
3. no snippet of information
The new site/new url was completed and listed some 9 months in the Yahoo directory, but has only one obscure page listed in Yahoo Search!
The new site contains some 30 pages of unique, hand written in context information, site map, correct navigation etc
It has a large number of incoming links.(although Yahoo only show 4)
Only Yahoo has problems listing this site.
Is it because the old url is still listed when it should not be? Does this old listing trip a dulpicate content penalty for the new site even though it should not be listed?
It does make on wonder
I pop in and out of yahoo every 3 month and I dont know why, I paid the last time, maybe that was a mistake, they problaly has a list over all paid listings and when the subscription ends you get kicked. the site has over 2200 links back on yahoo search and is listed on the directory so whyis out now.
It did apeare 3 days ago now its gone again, one thing is for sure Im not paying them again.
I have 16000 pages of my website listed in Google but none od these pages are listed in Yahoo.
Looks like everyone here is as confused as me