Welcome to WebmasterWorld Guest from 184.108.40.206 , register , free tools , login , search , pro membership , help , library , announcements , recent posts , open posts Become a Pro Member
New Googlebot What about crawl and crawler? kendos
I've made a new list of Googlebot after a study of my logs :
But I have some questions :
- Is crawlx.googlebot.com always mean that's a "Deep Crawl" and crawlerx.googlebot.com a "Fresh crawl"?
- There's 800 bots for crawlx, but in crawl7 and crawl9 it's not the same number in the IP range (29 and 21).
- Where is crawler19?
Eric (from France, sorry for my english)
[ edited by: WebGuerrilla at 11:39 pm (utc) on Feb. 28, 2003] [edit reason] TOS #13 [/edit]