Forum Moderators: open

Message Too Old, No Replies

Non-stop crawling

         

yoyo1

5:20 am on Nov 6, 2002 (gmt 0)

10+ Year Member



I recently put out a new site. I've noticed that Google has been crawling it non-stop every 30 seconds or so for the past 3 days! Is that normal? Although the urls are all different, most point back to the same content. Oh well.

thepcstore

6:43 am on Nov 6, 2002 (gmt 0)

10+ Year Member



Hi, yoyo1,

I posted yesterday about google taking a very large amount of data on our site during Monday and now after reviewing logs for it for yesterday find they've taken another 24MB. I'm aware of the phrase "deep crawl", but this is incredible! Whilst I haven't looked at the frequency of hits from the Gbot, the number of accesses reported is huge, too, so I can only conclude we are experiencing the same or similar thing you are.

Our SERPS, PR and positioning seems unaffected thus far, so more looking at us by G can only mean more likelihood of our site being higher in position. That's my guess anyhow.

Paul

percentages

7:00 am on Nov 6, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I see the same thing. A huge amount of deep crawling. But my SERPs have been affected and all positive. Many of my sites got damaged in the update....but the deep crawl seems to be correcting the problems.