Forum Moderators: open
I don't think there's a lot you can do, apart from cross your fingers and hope that one day Yahoo gets good at spidering.
In another recent thread, I gave as an example the Los Angeles Times, one of America's most respected newspapers and newspaper sites. Yahoo indexes only a tiny tiny fraction of what Google indexes on the site.
If Yahoo somehow thinks that the search world is better off not having the LA Times fully searchable, I beg to differ.
My experience is that Yahoo easily chokes on medium to large sites.
Yes, this would be a shame.
I mean I'm not here to 'bag' Yahoo, as their SERPS are very clean and relevant at present, as compared to some other engines...but with the Slurp algo' tuned so well it would be nice to see it slurp up some more useful content.
Yes Martinbuster, I did/do write most of it - at around 2-3 pages a day. But the field I'm in makes this easier than it sounds.
The weird thing is, is that it shows the index page twice, as if it indexed like 2 separate pages. I really thought submitting to the yahoo directory would make indexing and ranking quicker but I was way off.
My site went online in April. Yahoo slurp has over 6000+ hits on my site, almost 200/day lately.
I have 1 page on yahoo. Whens the freakin update coming?
My situation is almost exactly the same except that my site has been around since January. Yahoo bot is on my site daily and has been for months. Yahoo indexed pages recently reached an all-time high of 9 out of close to 1,000 pages.
The only thing I've noticed is that all 9 pages that are indexed have links pointing to them from other sites. I considered posting a site map of my main site on another site I own but decided to just wait it out.
A one thousand page website? Are we talking about quality original content or poor content like an affiliate feed of hotels that a hundred other webmasters are using?
Most of those pages are product pages with originally written descriptions and information about products I sell. Then about 150-200 of those pages are quality articles about the subject of the items I sell.
When I first started in January Y! had 600+ pages of mine indexed immediately, on the April 1st update it dropped to 8. Just checked today and it is now at 5 pages indexed.
Very strange as I am now sitting at around position 35 (give or take one depending on the day), but the sites ranked at #1-10 still seem to have 1000's of pages indexed with most of those pages deadlinks...
Don't know what Y! is doing. Finally made my way out of G's sandbox and holding at #20 with hope of one day soon at least being page 1. But with Y! I've actually given up all hope of ever ranking on the first page.
Most of those pages are product pages with originally written descriptions and information about products I sell.
At the risk of this turning into a site review, you may want to consider how many words are in the product descriptions. I like to have around 250-300 words per page.
You may also want to take a look at any indexing issues you might have related to dynamic content. Keeping things simple is very important, which means watching what you redirect. Links from sites that Yahoo likes help too.
So far we have a bunch of people talking about how they've lost pages but not enough specifics to connect dots to.
Are we talking dynamic sites?
How many words per pages, etc.
I have 1 page in Y and it's www.example.com
For starters www.example.com has always been 301 to example.com
Since April, slurp has had over 6000+ hits, what are they doing if not trying to add my site to the index?
I added some adbrite ads which gave me a page with them, it already shows up in the serps.
They have updated the www.example.com page multiple times, the latest being June 3rd.
I am having no such issues with MSN or Google. I am ranked in Alexa and am already in the ODP.
Are we talking dynamic sites?
How many words per pages, etc.
Most of our descriptions are around 300, but there are the few that are much bigger (more details to highlight) and a few that are a bit shorter (just not much to say about them).
The pages are all www.mysite.com/product-name-p-#.html
and I am using a 301 redirect from non-www to www.
I also have a redirect from the dynamic links
www.mysite.com/product.php?pid=30
to the static html page equivalent incase somewhere out there is a link to the dynamic, which I doubt.
G and MSN seem to have no trouble with the indexing, it's just y! that seems to not want to index us.
We were #1 on our search term on MSN for 5 months, so I know that it's atleast working on other search engines. It's just Y! that seems to be hating us.
Are we talking dynamic sites?
How many words per pages, etc.
Even in my wildest fantasies do I don't expect Yahoo to index my dynamic content (although Google and MSN do...)
I'm talking about static HTML linked straight off the home page, let alone the site map. I’m talking about pages which are the main pages for sub-categories in the site.
Sometimes posters assume that because their sites have not been affected and have been indexed (usually because they were indexed in a different time/era) that non indexed sites have an internal problem of some sort. This was the same attitude by those who would not believe in the sandbox - presumably because it didn't affect them.
Please! This is not that case here. Sites less than a year old are not getting properly indexed by Yahoo.
The reason why this is happening is an internal Yahoo issue (probably a space problem) – and is not always an internal website issue (although it will be in some cases).
Also, the original question was: The top page of my site is showing up in searches on Yahoo, but it's showing up as an IP address (#*$!.xx.xx.xx) ...not www.mydomain.com . None of the hundreds of other pages in this 7 year old site are showing up as being indexed, and they're not duplicate content. I'm at a loss as to how to fix this so that Yahoo will crawl the entire site.
Dave
[edited by: martinibuster at 6:04 pm (utc) on June 17, 2005]
[edit reason] cleanup [/edit]
[webmasterworld.com...]
This is what is showing for me at yahoo,
example.com/?M=D (they keep re-caching this page)
example.com/?N=A
example.com/?M=A
What if I was to put a 301 redirect on these pages? Would that just add more penalties?