Welcome to WebmasterWorld Guest from 23.22.140.143

Forum Moderators: open

Message Too Old, No Replies

Has Deep Crawl Begun?

Let's Understend Has it Begun or not?

     
5:46 pm on Jan 28, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:Oct 7, 2002
posts:403
votes: 0


Friends,
Has Deep Crawl Hit AnyBody's Site?
As For me I've not seen deep crawlbot yet.

Noximus

7:00 pm on Jan 28, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Nov 19, 2002
posts:2139
votes: 0


I have not seen the deepcrawl either. And it is on a PR 7 page that the bot generally loves. Oddly enough, I was getting hammered by the freshbot during the dance. Let's wait and see.
7:10 pm on Jan 28, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Jan 3, 2003
posts:58
votes: 0


My sites usually get hammered throughout the duration of the deep crawl and, thus far, I've not had a visit. As others have noted, however, I have been gettting a lot of visits from the "fresh" crawler (i.e., googlebot10,11 and 12).
7:12 pm on Jan 28, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member ciml is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:June 22, 2001
posts:3805
votes: 2


Took 72 hours to reach me last time. 04:45am GMT tomorrow morning?
12:45 pm on Jan 29, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:June 3, 2002
posts:142
votes: 0


Anyone hit by the deepcrawler yet?

I've seen a lot of freshbot so far, especially during the update, but no deepcrawler. This seems to be a longer delay than normal. (I've a PR6/5 index page site which tends to get hit a little after some of the PR heavyweights here).

1:32 pm on Jan 29, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Nov 4, 2002
posts:1687
votes: 0


Nothing here yet on a PR6 site.
7:48 am on Feb 6, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:June 3, 2002
posts:142
votes: 0


Deep crawler is alive on my PR5 site.
7:50 am on Feb 6, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member nick_w is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Feb 4, 2002
posts:5044
votes: 0


Confirm that with an IP address? ;)

Nick

7:53 am on Feb 6, 2003 (gmt 0)

Full Member

10+ Year Member

joined:Nov 8, 2002
posts:223
votes: 0


Same here

216.239.46.77 - - [06/Feb/2003:03:49:41 +0000] "GET /sitemap.html HTTP/1.0" 200 6208

7:54 am on Feb 6, 2003 (gmt 0)

Full Member

10+ Year Member

joined:Oct 16, 2002
posts:205
votes: 0


216.239.46.x is now eating a lot of fresh content :)

Must be very hungry, so let's give her content, content or content...

8:04 am on Feb 6, 2003 (gmt 0)

New User

10+ Year Member

joined:Nov 26, 2002
posts:14
votes: 0


deepcrawl bot is all over my sites like a rash..

216.239.46.172

9:30 am on Feb 6, 2003 (gmt 0)

New User

10+ Year Member

joined:Nov 28, 2004
posts:2
votes: 0


Hi

The deep crawl is active on my sites here in France,
ip: 216.239.46.30, 216.239.46.101 etc...

It behaves a little strangely (it crawls a page, another one hour later, and so on) but I think it's warming up :)

Good luck with this crawl!

Sepang

ps: waw! my first post! 8)

11:46 am on Feb 6, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:June 3, 2002
posts:142
votes: 0


Hey Nick, yes, you're right I should have quoted the 216.239.. but I figured there was no need given my earlier post in this topic. :)

Started slow at first, but has done a couple of thousand pages already.

11:51 am on Feb 6, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member nick_w is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Feb 4, 2002
posts:5044
votes: 0


No worries, didn't read your earler one, sorry!

Nick

11:55 am on Feb 6, 2003 (gmt 0)

New User

10+ Year Member

joined:Nov 24, 2002
posts:19
votes: 0


Deepcrawl is (very) active on our PR6!
12:19 pm on Feb 6, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member suzyuk is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Oct 1, 2002
posts:5199
votes: 0


anyone help? I've new logs and they're not showing the IP for everything sometimes it's names, Google being one

they now say e.g.
crawl5.googlebot.com

what's the names of the Freshbots and the deepcrawl bots?

Suzy

1:14 pm on Feb 6, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Dec 31, 2002
posts:150
votes: 0


From logs,

Visitor 216.239.46.124 on Thu Feb 6 06:03:33 2003 using Googlebot/2.1 (+http://www.googlebot.com/bot.html)

Getting lots of lines like this at the mo,

1:18 pm on Feb 6, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Dec 31, 2002
posts:150
votes: 0


SuzyUK, have a look at

[webmasterworld.com...]

& the thread linked from there

Has some info on IP's etc. for Googlebots. Not sure how up-to date though?

2:57 pm on Feb 6, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Jan 31, 2003
posts:91
votes: 0


Hi, I'm new to the forum and I wondered if anyone can tell me what I need to search for in the log files to find the googlebot? Also, what does PR5, 6, 7 mean.

Thanks

5:57 pm on Feb 6, 2003 (gmt 0)

Full Member

10+ Year Member

joined:May 16, 2002
posts:223
votes: 0


Welcome to Webmaster World doodledunk.

what I need to search for in the log files to find the googlebot?

Search for "Googlebot". For example:
"Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

what does PR5, 6, 7 mean

There are a number of "PageRank" FAQ's in the Webmaster World Google Knowledge Base [webmasterworld.com].



Continued:
[webmasterworld.com...]