Welcome to WebmasterWorld Guest from

Forum Moderators: Robert Charlton & aakk9999 & andy langton & goodroi

Message Too Old, No Replies

One of our domain is not crawled for the past 20 days

1:46 pm on Jan 7, 2011 (gmt 0)

New User

10+ Year Member

joined:Dec 15, 2005
posts: 10
votes: 0

One of our domains is not crawled for the past 20 days. Seeing some other popular websites are also having the same problem. We have few other domains that are crawled even yesterday.

Any one facing this issue? I just checked cisco.com.It is also not cached after 16th dec.

2:37 pm on Jan 7, 2011 (gmt 0)

Senior Member

joined:June 3, 2007
votes: 0

Any one facing this issue?

There have been some very strange things happening the past couple of months, I have seen new sites indexed and ranking immediately meanwhile other sites which have been crawled but not indexed.

I think there must be a BIG queue of stuff waiting to appear!

Just how much this has to do with Xmas shopping and sales sites I have no idea but something tells me it is.
9:47 pm on Jan 10, 2011 (gmt 0)

New User

5+ Year Member

joined:Jan 10, 2011
votes: 0

A lot of sites havnt been crawled since this date, many have but this has not been reflected in the rankings or even the site's cache.
Then a tiny few have reported improvements in rankings despite an old cache and a few others have shown updated caches but with older dates, that I suggest it to be expected (due to how caching actually works) but its not something that has been previously reported, as the synch delay was a day or two, not days to weeks.

Crawling/update cron priorities have I suggest be turned down significantly so that most of the resources are available to complete a total rebuild of the index utilizing an updated schema with additional quality factors.