Forum Moderators: open

Message Too Old, No Replies

Yahoo's spidering frequency, index update and my patience

Are they slow or is this normal?

         

elguiri

9:43 am on Apr 14, 2005 (gmt 0)

10+ Year Member Top Contributors Of The Month



I have a new site - 5,000 pages approximately - that was heavily spidered by Yahoo about 12 days ago. Slurp rolled in in the middle of the afternoon, and did about 1,700 pages in one sitting.

Since then, Yahoo has bothered with little more than the index page, and if I search for the all the pages in the site, it only comes up with 3 (these pages are in the serps).

Although this may have coincided with this update [webmasterworld.com], is Yahoo usually this slow in passing spidered content to search results, or should I try learning how to take it easy?

robotsdobetter

9:12 pm on Apr 14, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Sometimes they are very slow at updating the index. While you are waiting I suggest that you look at your site for reasons (Coding error, Frames, etc.) that may cause Yahoo! Slurp to have trouble spidering your web site. I would try to get a few web sites to link to a few deep pages on your web site.

elguiri

9:25 pm on Apr 14, 2005 (gmt 0)

10+ Year Member Top Contributors Of The Month



Thanks for that.

There shouldn't be any spidering problems. They're all fairly simple, and G, Ask and MSN have all been picking up chunks of it.

In fact Google lists 8500 pages! (That's another story)

StupidScript

9:35 pm on Apr 14, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



See a bunch of other threads in this and other forums for people in your shoes, or worse (established sites did well in SERPS until not long ago when they vanished, etc.). Y is being weird.

elguiri

9:55 pm on Apr 14, 2005 (gmt 0)

10+ Year Member Top Contributors Of The Month



Can you reference any such threads in WebmasterWorld?

This afternoon I have, happily, FOUR pages indexed in Yahoo. This novelty comes not from recent indexing. The fourth page was indexed a week ago.

In the meantime, I'll just add more links!

StupidScript

10:25 pm on Apr 14, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Here are three threads in this forum that speak to your issue ... unfortunately, no answers and wildly varying results, but you'll see some familiar comments:

[webmasterworld.com...]
[webmasterworld.com...]
[webmasterworld.com...]

elguiri

11:12 pm on Apr 14, 2005 (gmt 0)

10+ Year Member Top Contributors Of The Month



Thanks!