Is the deepcrawl over?

Forum Moderators: open

Message Too Old, No Replies

Is the deepcrawl over?

Why did only my homepages get picked up?

CosmicDan

10:56 pm on Apr 21, 2003 (gmt 0)

Is Deepbot still out there?

Anyone else having the issue where it just takes robots and / and fails to crawl?

finoo

11:40 pm on Apr 21, 2003 (gmt 0)

Saw deepbot still crawling my site this morning.. So i guess its still out there.

Kerrin

11:59 pm on Apr 21, 2003 (gmt 0)

Hey CosmicDan,

Google deepcrawler started on the 15th and it usually crawls for about 10 or 11 days.

markusf

12:09 am on Apr 22, 2003 (gmt 0)

nearly done crawling my site...

uber_boy

12:27 am on Apr 22, 2003 (gmt 0)

The Deep Crawl's been happening at my site for several days now and shows no sign of letting up. 89000 pages and counting...

bkk344

1:03 am on Apr 22, 2003 (gmt 0)

Deepcrawler is absolutely gobbling it's way through thousands of pages on several sites, and is showing no signs of letting up.

Critter

1:05 am on Apr 22, 2003 (gmt 0)

Deep's merrily gobbling up 000s of pages here too...

Peter

reneewood

4:02 am on Apr 22, 2003 (gmt 0)

It doesn't look like the deepcrawler or freshbot has been to my site. Should I be worried? Is it too late for me to be crawled?

I'm relying on this new webstats program to let me know who has been there. So far, no 216.239 or 64.68.82

markusf

4:03 am on Apr 22, 2003 (gmt 0)

If your site is over PR2 i wouldn't worry about it

futureX

4:50 am on Apr 22, 2003 (gmt 0)

Still crawling at this very second... PR4 site.

Oaf357

4:56 am on Apr 22, 2003 (gmt 0)

Still crawling my site too.

I've made site wide changes too during the crawl. Should be interesting to see the results.