Welcome to WebmasterWorld Guest from 54.162.141.212

Forum Moderators: open

Message Too Old, No Replies

Has Deep Crawl Begun?

Let's Understend Has it Begun or not?

     
5:46 pm on Jan 28, 2003 (gmt 0)

10+ Year Member



Friends,
Has Deep Crawl Hit AnyBody's Site?
As For me I've not seen deep crawlbot yet.

Noximus

7:00 pm on Jan 28, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I have not seen the deepcrawl either. And it is on a PR 7 page that the bot generally loves. Oddly enough, I was getting hammered by the freshbot during the dance. Let's wait and see.
7:10 pm on Jan 28, 2003 (gmt 0)

10+ Year Member



My sites usually get hammered throughout the duration of the deep crawl and, thus far, I've not had a visit. As others have noted, however, I have been gettting a lot of visits from the "fresh" crawler (i.e., googlebot10,11 and 12).
7:12 pm on Jan 28, 2003 (gmt 0)

WebmasterWorld Senior Member ciml is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Took 72 hours to reach me last time. 04:45am GMT tomorrow morning?
12:45 pm on Jan 29, 2003 (gmt 0)

10+ Year Member



Anyone hit by the deepcrawler yet?

I've seen a lot of freshbot so far, especially during the update, but no deepcrawler. This seems to be a longer delay than normal. (I've a PR6/5 index page site which tends to get hit a little after some of the PR heavyweights here).

1:32 pm on Jan 29, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Nothing here yet on a PR6 site.
7:48 am on Feb 6, 2003 (gmt 0)

10+ Year Member



Deep crawler is alive on my PR5 site.
7:50 am on Feb 6, 2003 (gmt 0)

WebmasterWorld Senior Member nick_w is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Confirm that with an IP address? ;)

Nick

7:53 am on Feb 6, 2003 (gmt 0)

10+ Year Member



Same here

216.239.46.77 - - [06/Feb/2003:03:49:41 +0000] "GET /sitemap.html HTTP/1.0" 200 6208

7:54 am on Feb 6, 2003 (gmt 0)

10+ Year Member



216.239.46.x is now eating a lot of fresh content :)

Must be very hungry, so let's give her content, content or content...

8:04 am on Feb 6, 2003 (gmt 0)

10+ Year Member



deepcrawl bot is all over my sites like a rash..

216.239.46.172

9:30 am on Feb 6, 2003 (gmt 0)

10+ Year Member



Hi

The deep crawl is active on my sites here in France,
ip: 216.239.46.30, 216.239.46.101 etc...

It behaves a little strangely (it crawls a page, another one hour later, and so on) but I think it's warming up :)

Good luck with this crawl!

Sepang

ps: waw! my first post! 8)

11:46 am on Feb 6, 2003 (gmt 0)

10+ Year Member



Hey Nick, yes, you're right I should have quoted the 216.239.. but I figured there was no need given my earlier post in this topic. :)

Started slow at first, but has done a couple of thousand pages already.

11:51 am on Feb 6, 2003 (gmt 0)

WebmasterWorld Senior Member nick_w is a WebmasterWorld Top Contributor of All Time 10+ Year Member



No worries, didn't read your earler one, sorry!

Nick

11:55 am on Feb 6, 2003 (gmt 0)

10+ Year Member



Deepcrawl is (very) active on our PR6!
12:19 pm on Feb 6, 2003 (gmt 0)

WebmasterWorld Senior Member suzyuk is a WebmasterWorld Top Contributor of All Time 10+ Year Member



anyone help? I've new logs and they're not showing the IP for everything sometimes it's names, Google being one

they now say e.g.
crawl5.googlebot.com

what's the names of the Freshbots and the deepcrawl bots?

Suzy

1:14 pm on Feb 6, 2003 (gmt 0)

10+ Year Member



From logs,

Visitor 216.239.46.124 on Thu Feb 6 06:03:33 2003 using Googlebot/2.1 (+http://www.googlebot.com/bot.html)

Getting lots of lines like this at the mo,

1:18 pm on Feb 6, 2003 (gmt 0)

10+ Year Member



SuzyUK, have a look at

[webmasterworld.com...]

& the thread linked from there

Has some info on IP's etc. for Googlebots. Not sure how up-to date though?

2:57 pm on Feb 6, 2003 (gmt 0)

10+ Year Member



Hi, I'm new to the forum and I wondered if anyone can tell me what I need to search for in the log files to find the googlebot? Also, what does PR5, 6, 7 mean.

Thanks

5:57 pm on Feb 6, 2003 (gmt 0)

10+ Year Member



Welcome to Webmaster World doodledunk.

what I need to search for in the log files to find the googlebot?

Search for "Googlebot". For example:
"Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

what does PR5, 6, 7 mean

There are a number of "PageRank" FAQ's in the Webmaster World Google Knowledge Base [webmasterworld.com].



Continued:
[webmasterworld.com...]
 

Featured Threads

Hot Threads This Week

Hot Threads This Month