Forum Moderators: open

Message Too Old, No Replies

Yahoo recrawl?

         

backwater

9:15 pm on Feb 28, 2006 (gmt 0)

10+ Year Member



Just curious as to how often yahoo will crawl a site again. I just recently overhauled my site, but the search return is still showing the old title bar. Google already has the new site indexed. I resubmitted to both. Thanks.

trinorthlighting

1:33 pm on Mar 5, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I am getting a very large crawl.

BillyS

8:00 pm on Mar 9, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Yeah, what's up with Slurp - 4614 pages so far this month - that's nearly 600 pages a day for a site that only has 1,100 pages. Something's up.

BillyS

2:38 am on Mar 14, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Am I the only one getting all this attention? As of yesterday 7,300 page - 608 per day for 12 days on a site with only 1,100 pages.

The good news is Slurp takes gziped pages.

BillyS

1:28 pm on Mar 18, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



>>Am I the only one getting all this attention? As of yesterday 7,300 page - 608 per day for 12 days on a site with only 1,100 pages.

I cant believe I'm the only one experiencing this...

10,400 pages and 1,830 robots.txt hits as of yesterday - still at a pace of over 600 pages a day.

mfishy

2:18 pm on Mar 18, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



slurp is quite active and i am looking at a large smaple of sites/pages. One can only hope they will use this data to do something other than simply cache pages...

afterburner

6:00 pm on Mar 18, 2006 (gmt 0)

10+ Year Member



I get crawled all the time by Slurp but it takes forever to get new stuff into the index

BillyS

11:37 am on Mar 24, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Okay a bit different news to report here today. As of March 22nd, Slurp had crawled over 15,000 pages (again, the site only has 1,100 pages). I think this works out to around 680 pages per day.

Today I'm seeing a big (everything is relative with Yahoo) jump in page count from around 780 pages to 960 pages. This is one of the largest jumps in count for me ever in Yahoo.