I have not seen the deepcrawl either. And it is on a PR 7 page that the bot generally loves. Oddly enough, I was getting hammered by the freshbot during the dance. Let's wait and see.
My sites usually get hammered throughout the duration of the deep crawl and, thus far, I've not had a visit. As others have noted, however, I have been gettting a lot of visits from the "fresh" crawler (i.e., googlebot10,11 and 12).
Took 72 hours to reach me last time. 04:45am GMT tomorrow morning?
Anyone hit by the deepcrawler yet?
I've seen a lot of freshbot so far, especially during the update, but no deepcrawler. This seems to be a longer delay than normal. (I've a PR6/5 index page site which tends to get hit a little after some of the PR heavyweights here).
Nothing here yet on a PR6 site.
Deep crawler is alive on my PR5 site.
Confirm that with an IP address? ;)
220.127.116.11 - - [06/Feb/2003:03:49:41 +0000] "GET /sitemap.html HTTP/1.0" 200 6208
216.239.46.x is now eating a lot of fresh content :)
Must be very hungry, so let's give her content, content or content...
deepcrawl bot is all over my sites like a rash..
The deep crawl is active on my sites here in France,
ip: 18.104.22.168, 22.214.171.124 etc...
It behaves a little strangely (it crawls a page, another one hour later, and so on) but I think it's warming up :)
Good luck with this crawl!
ps: waw! my first post! 8)
Hey Nick, yes, you're right I should have quoted the 216.239.. but I figured there was no need given my earlier post in this topic. :)
Started slow at first, but has done a couple of thousand pages already.
No worries, didn't read your earler one, sorry!
Deepcrawl is (very) active on our PR6!
anyone help? I've new logs and they're not showing the IP for everything sometimes it's names, Google being one
they now say e.g.
what's the names of the Freshbots and the deepcrawl bots?
Visitor 126.96.36.199 on Thu Feb 6 06:03:33 2003 using Googlebot/2.1 (+http://www.googlebot.com/bot.html)
Getting lots of lines like this at the mo,
SuzyUK, have a look at
& the thread linked from there
Has some info on IP's etc. for Googlebots. Not sure how up-to date though?
Hi, I'm new to the forum and I wondered if anyone can tell me what I need to search for in the log files to find the googlebot? Also, what does PR5, 6, 7 mean.
Welcome to Webmaster World doodledunk.
|what I need to search for in the log files to find the googlebot? |
Search for "Googlebot". For example:
There are a number of "PageRank" FAQ's in the Webmaster World Google Knowledge Base [webmasterworld.com].