Welcome to WebmasterWorld Guest from 54.211.11.50

Forum Moderators: open

Message Too Old, No Replies

Deep crawl slow recently

3 sites waiting for over a month

     
12:37 pm on Sep 2, 2004 (gmt 0)

New User

10+ Year Member

joined:Dec 8, 2003
posts:7
votes: 0


Has anyone noticed Google's deep crawl taking a long time over the last month?

I have three new sites launched last month, all have their home page recently indexed but no other pages.

I have linked to them from my companies PR5 portfolio page.

1:52 pm on Sept 2, 2004 (gmt 0)

Junior Member

10+ Year Member

joined:Aug 22, 2002
posts:61
votes: 0


Hey Flak,

I am noticing the same. I have launched a couple sites recently that just are not being picked up. I haven't seen a major update or deep crawl for quite some time...

Brass

2:10 pm on Sept 2, 2004 (gmt 0)

New User

10+ Year Member

joined:Nov 29, 2003
posts:18
votes: 0


Experiencing the same with a new site launched last month. Was crawled at first but hasnt been touched for the last 4 weeks -- have added new pages since.

Site is still in the sandbox.

2:26 pm on Sept 3, 2004 (gmt 0)

New User

10+ Year Member

joined:Sept 3, 2004
posts:23
votes: 0


I have same problem since last week, it seems very 'shy' now. Normally it have more than 20000 occurrence in my log file. Now only less than 100. Google really has reached it's docID limitaion? I want to know .
2:46 pm on Sept 3, 2004 (gmt 0)

New User

10+ Year Member

joined:Dec 8, 2003
posts:7
votes: 0


I think a storm is brewing, theres been some odd happenings with the rankings over the last week and www2 and www3 are MIA.

Batten down the hatches...

3:39 pm on Sept 3, 2004 (gmt 0)

Junior Member

10+ Year Member

joined:July 12, 2004
posts:58
votes: 0


I think Googlebot has just been very busy crawling my site and didn't have time for others :-))
9:03 pm on Sept 3, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:July 14, 2003
posts:1783
votes: 0


I submitted my 1400 page site on June 14th. Until today, only a couple of pages were in the index. I've been cultivating inbound links in the meantime, as well as adding content.

Today I found that G had picked up 200+ more pages, and some are even ranking decently (not good, but decent) for particular keywords.

The sandbox is there, but I'm seeing progress.

2:48 am on Sept 5, 2004 (gmt 0)

Junior Member

10+ Year Member

joined:Feb 7, 2004
posts:104
votes: 0


Googlebot visits daily, but only for a few hundred pages out of 15,000. Previously had a deep crawl once a month, but haven't seen one in over two months.

All pages still ranking well, but am concerned about this lack of activity.

5:58 pm on Sept 5, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Dec 31, 2002
posts:880
votes: 0


I had the same problem for a month. G visited the home page every single day and nothing more. I thought I had screwed up robots text. Suddenly it took the lot. Still waiting for position though!
7:27 pm on Sept 5, 2004 (gmt 0)

Preferred Member

10+ Year Member

joined:Nov 22, 2002
posts:403
votes: 0


I have a 2 year old site that usually gets several hundred pages spidered daily, it has dropped to 1-2 day since Fri? Something is surely up, don't know what though.