Forum Moderators: open

Message Too Old, No Replies

How to get Slurp to index all the pages

the index site and main categories are indexed but

         

walkman

1:54 am on May 1, 2004 (gmt 0)



I'm having trouble with them indexing the individual product pages. The main categories are in but that's about it. The products are linked at least twice; once from the categories and once in the sitemap. Both the categories and the sitemap are indexed. Also, the product pages are rewriten so the're not a problem to spider.

More incoming links? I know it matters with Google as far as getting indexed deep, but does it matter with Y! too?

2_much

3:25 am on May 2, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Yes, definitely, more links helps.

If you're not in Sitematch, it takes longer for you to get crawled, and that depends on whether you have strong links from sites that are well indexed in Yahoo's database.

I would work on getting more links if possible to some of the subpages, including the sitemap.

walkman

3:46 am on May 2, 2004 (gmt 0)



Yesterday I linked to the sitemap from a few of my other sites. Not crosslinked or anything fishy. Hopefully it works,

thank you

atlrus

3:46 pm on May 2, 2004 (gmt 0)

10+ Year Member



good luck with that.
I use sitematch, i have over 3,000 links to my website, and my sitemap is indexed in yahoo, but the total urls indexed is 3 out of over 2,000.

sandor

4:25 pm on May 2, 2004 (gmt 0)

10+ Year Member



not sure if i can offer much advice on this, but i got a whole tonne of pr4 incoming links to a particular new site ... everyday google keeps grabbing the index and nothing else .. bout a week and a half now. then suddenly on friday/saturday yahoo slurp appeared and basically gobbled down the whole site .. several hundred pages in fact. so good luck!

walkman

5:19 pm on May 4, 2004 (gmt 0)



checked my logs and slurp is finally indexing them one by one. Grabbed about 100 or so pages today. Does it matter who links you as far as popularity goes with Y!?

I mean google has the PR but I don't know if Y! uses anything like that. What do you think? Is a link fron CNN the same as a link from blablah.com?

thanks to all