Forum Moderators: open

Message Too Old, No Replies

Where is all this crawling going?

Yahoo!Slurp been busy for months with no update

         

Seattle_SEM

4:32 pm on Jul 15, 2004 (gmt 0)

10+ Year Member



Is it just me, or is Yahoo! Slurp crawling a ton of content, and just sending it off into the dump-heap somewhere?

The cache of all my pages is from April - is Yahoo! that out of date for everyone?

Just an example, they've got 1,200 pages from one of my domains "live", but they've been crawling 500/day for months now. Where is this freshly crawled stuff going? Is Yahoo! now going an update like Google used to? IE, one big one every so often?

Seattle_SEM

helenp

4:28 pm on Jul 16, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I think they have rolling update, my pages comes in slowly....1 every second or third day, depends