homepage Welcome to WebmasterWorld Guest from 54.211.219.68
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Google / Google News Archive
Forum Library, Charter, Moderator: open

Google News Archive Forum

    
Has Deep Crawl Begun?
Let's Understend Has it Begun or not?
Noximus

10+ Year Member



 
Msg#: 8825 posted 5:46 pm on Jan 28, 2003 (gmt 0)

Friends,
Has Deep Crawl Hit AnyBody's Site?
As For me I've not seen deep crawlbot yet.

Noximus

 

mfishy

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 8825 posted 7:00 pm on Jan 28, 2003 (gmt 0)

I have not seen the deepcrawl either. And it is on a PR 7 page that the bot generally loves. Oddly enough, I was getting hammered by the freshbot during the dance. Let's wait and see.

uber_boy

10+ Year Member



 
Msg#: 8825 posted 7:10 pm on Jan 28, 2003 (gmt 0)

My sites usually get hammered throughout the duration of the deep crawl and, thus far, I've not had a visit. As others have noted, however, I have been gettting a lot of visits from the "fresh" crawler (i.e., googlebot10,11 and 12).

ciml

WebmasterWorld Senior Member ciml us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 8825 posted 7:12 pm on Jan 28, 2003 (gmt 0)

Took 72 hours to reach me last time. 04:45am GMT tomorrow morning?

KakenBetaal

10+ Year Member



 
Msg#: 8825 posted 12:45 pm on Jan 29, 2003 (gmt 0)

Anyone hit by the deepcrawler yet?

I've seen a lot of freshbot so far, especially during the update, but no deepcrawler. This seems to be a longer delay than normal. (I've a PR6/5 index page site which tends to get hit a little after some of the PR heavyweights here).

Stefan

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 8825 posted 1:32 pm on Jan 29, 2003 (gmt 0)

Nothing here yet on a PR6 site.

KakenBetaal

10+ Year Member



 
Msg#: 8825 posted 7:48 am on Feb 6, 2003 (gmt 0)

Deep crawler is alive on my PR5 site.

Nick_W

WebmasterWorld Senior Member nick_w us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 8825 posted 7:50 am on Feb 6, 2003 (gmt 0)

Confirm that with an IP address? ;)

Nick

bluecorr

10+ Year Member



 
Msg#: 8825 posted 7:53 am on Feb 6, 2003 (gmt 0)

Same here

216.239.46.77 - - [06/Feb/2003:03:49:41 +0000] "GET /sitemap.html HTTP/1.0" 200 6208

pardo

10+ Year Member



 
Msg#: 8825 posted 7:54 am on Feb 6, 2003 (gmt 0)

216.239.46.x is now eating a lot of fresh content :)

Must be very hungry, so let's give her content, content or content...

aka ferrari360

10+ Year Member



 
Msg#: 8825 posted 8:04 am on Feb 6, 2003 (gmt 0)

deepcrawl bot is all over my sites like a rash..

216.239.46.172

sepang

10+ Year Member



 
Msg#: 8825 posted 9:30 am on Feb 6, 2003 (gmt 0)

Hi

The deep crawl is active on my sites here in France,
ip: 216.239.46.30, 216.239.46.101 etc...

It behaves a little strangely (it crawls a page, another one hour later, and so on) but I think it's warming up :)

Good luck with this crawl!

Sepang

ps: waw! my first post! 8)

KakenBetaal

10+ Year Member



 
Msg#: 8825 posted 11:46 am on Feb 6, 2003 (gmt 0)

Hey Nick, yes, you're right I should have quoted the 216.239.. but I figured there was no need given my earlier post in this topic. :)

Started slow at first, but has done a couple of thousand pages already.

Nick_W

WebmasterWorld Senior Member nick_w us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 8825 posted 11:51 am on Feb 6, 2003 (gmt 0)

No worries, didn't read your earler one, sorry!

Nick

JLindsay

10+ Year Member



 
Msg#: 8825 posted 11:55 am on Feb 6, 2003 (gmt 0)

Deepcrawl is (very) active on our PR6!

SuzyUK

WebmasterWorld Senior Member suzyuk us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 8825 posted 12:19 pm on Feb 6, 2003 (gmt 0)

anyone help? I've new logs and they're not showing the IP for everything sometimes it's names, Google being one

they now say e.g.
crawl5.googlebot.com

what's the names of the Freshbots and the deepcrawl bots?

Suzy

ga_ga

10+ Year Member



 
Msg#: 8825 posted 1:14 pm on Feb 6, 2003 (gmt 0)

From logs,

Visitor 216.239.46.124 on Thu Feb 6 06:03:33 2003 using Googlebot/2.1 (+http://www.googlebot.com/bot.html)

Getting lots of lines like this at the mo,

ga_ga

10+ Year Member



 
Msg#: 8825 posted 1:18 pm on Feb 6, 2003 (gmt 0)

SuzyUK, have a look at

[webmasterworld.com...]

& the thread linked from there

Has some info on IP's etc. for Googlebots. Not sure how up-to date though?

doodledunk

10+ Year Member



 
Msg#: 8825 posted 2:57 pm on Feb 6, 2003 (gmt 0)

Hi, I'm new to the forum and I wondered if anyone can tell me what I need to search for in the log files to find the googlebot? Also, what does PR5, 6, 7 mean.

Thanks

gmoney

10+ Year Member



 
Msg#: 8825 posted 5:57 pm on Feb 6, 2003 (gmt 0)

Welcome to Webmaster World doodledunk.

what I need to search for in the log files to find the googlebot?

Search for "Googlebot". For example:
"Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

what does PR5, 6, 7 mean

There are a number of "PageRank" FAQ's in the Webmaster World Google Knowledge Base [webmasterworld.com].



Continued:
[webmasterworld.com...]

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google News Archive
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved