Has Deep Crawl Begun?

Forum Moderators: open

Message Too Old, No Replies

Has Deep Crawl Begun?

Let's Understend Has it Begun or not?

Noximus

5:46 pm on Jan 28, 2003 (gmt 0)

Friends,
Has Deep Crawl Hit AnyBody's Site?
As For me I've not seen deep crawlbot yet.

Noximus

mfishy

7:00 pm on Jan 28, 2003 (gmt 0)

I have not seen the deepcrawl either. And it is on a PR 7 page that the bot generally loves. Oddly enough, I was getting hammered by the freshbot during the dance. Let's wait and see.

uber_boy

7:10 pm on Jan 28, 2003 (gmt 0)

My sites usually get hammered throughout the duration of the deep crawl and, thus far, I've not had a visit. As others have noted, however, I have been gettting a lot of visits from the "fresh" crawler (i.e., googlebot10,11 and 12).

ciml

7:12 pm on Jan 28, 2003 (gmt 0)

Took 72 hours to reach me last time. 04:45am GMT tomorrow morning?

KakenBetaal

12:45 pm on Jan 29, 2003 (gmt 0)

Anyone hit by the deepcrawler yet?

I've seen a lot of freshbot so far, especially during the update, but no deepcrawler. This seems to be a longer delay than normal. (I've a PR6/5 index page site which tends to get hit a little after some of the PR heavyweights here).

Stefan

1:32 pm on Jan 29, 2003 (gmt 0)

Nothing here yet on a PR6 site.

KakenBetaal

7:48 am on Feb 6, 2003 (gmt 0)

Deep crawler is alive on my PR5 site.

Nick_W

7:50 am on Feb 6, 2003 (gmt 0)

Confirm that with an IP address? ;)

Nick

bluecorr

7:53 am on Feb 6, 2003 (gmt 0)

Same here

216.239.46.77 - - [06/Feb/2003:03:49:41 +0000] "GET /sitemap.html HTTP/1.0" 200 6208

pardo

7:54 am on Feb 6, 2003 (gmt 0)

216.239.46.x is now eating a lot of fresh content :)

Must be very hungry, so let's give her content, content or content...

aka ferrari360

8:04 am on Feb 6, 2003 (gmt 0)

deepcrawl bot is all over my sites like a rash..

216.239.46.172

sepang

9:30 am on Feb 6, 2003 (gmt 0)

The deep crawl is active on my sites here in France,
ip: 216.239.46.30, 216.239.46.101 etc...

It behaves a little strangely (it crawls a page, another one hour later, and so on) but I think it's warming up :)

Good luck with this crawl!

Sepang

ps: waw! my first post! 8)

KakenBetaal

11:46 am on Feb 6, 2003 (gmt 0)

Hey Nick, yes, you're right I should have quoted the 216.239.. but I figured there was no need given my earlier post in this topic. :)

Started slow at first, but has done a couple of thousand pages already.

Nick_W

11:51 am on Feb 6, 2003 (gmt 0)

No worries, didn't read your earler one, sorry!

Nick

JLindsay

11:55 am on Feb 6, 2003 (gmt 0)

Deepcrawl is (very) active on our PR6!

SuzyUK

12:19 pm on Feb 6, 2003 (gmt 0)

anyone help? I've new logs and they're not showing the IP for everything sometimes it's names, Google being one

they now say e.g.
crawl5.googlebot.com

what's the names of the Freshbots and the deepcrawl bots?

Suzy

ga_ga

1:14 pm on Feb 6, 2003 (gmt 0)

From logs,

Visitor 216.239.46.124 on Thu Feb 6 06:03:33 2003 using Googlebot/2.1 (+http://www.googlebot.com/bot.html)

Getting lots of lines like this at the mo,

ga_ga

1:18 pm on Feb 6, 2003 (gmt 0)

SuzyUK, have a look at

[webmasterworld.com...]

& the thread linked from there

Has some info on IP's etc. for Googlebots. Not sure how up-to date though?

doodledunk

2:57 pm on Feb 6, 2003 (gmt 0)

Hi, I'm new to the forum and I wondered if anyone can tell me what I need to search for in the log files to find the googlebot? Also, what does PR5, 6, 7 mean.

Thanks

gmoney

5:57 pm on Feb 6, 2003 (gmt 0)

Welcome to Webmaster World doodledunk.

what I need to search for in the log files to find the googlebot?

Search for "Googlebot". For example:
"Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

what does PR5, 6, 7 mean

There are a number of "PageRank" FAQ's in the Webmaster World Google Knowledge Base [webmasterworld.com].

Continued:
[webmasterworld.com...]