| Welcome to WebmasterWorld Guest from 220.127.116.11 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Pubcon Gold Sponsor 2015! |
|Freshbot still on a rampage...|
over 1000 pages hit so far today
This is the first tome I've seen so much activity from freshbot so close to the (announced) dance.
Anyone else seeing this as well?
Yes, I can confirm that. Googlebot is going through at least one website I have right now
What PR do you have? Our site only has a PR4 and no sight of Freshbot since March 3.
going through my site would be an understatement! It's hitting me harder and deeper than it does during a normal deep crawl!
<added>PR6 home page with around 60 PR5 pages. Hundreds of PR4 and it's hitting a lot of the PR2 and PR3 pages</added>
PR6 with about 3200+ pages in the index
No PR yet on my website. Totally new with links added to it just last night.
what ips are you guys getting?
xerxes, my PR4 sites are not being crawled, but PR5+ sites are being crawled now.
o0_cops_0o, I'm getting hit by crawler11.googlebot.com and crawler12.googlebot.com
I have three VERY HUNGRY bots active on a PR4 site...
18.104.22.168 - - [06/Mar/2003:18:09:02 -0800]
22.214.171.124 - - [06/Mar/2003:18:05:50 -0800]
126.96.36.199 - - [06/Mar/2003:17:55:37 -0800]
( Ask Jeeves/Teoma)
Freshbot is going for things he has not touched in months
Ok, someone else just joined the party..
188.8.131.52 - - [06/Mar/2003:18:20:16 -0800]
[edited by: mrkarron at 2:28 am (utc) on Mar. 7, 2003]
strange..im getting deep crawlers 184.108.40.206 Google Inc. US,CA proxy.google.com
I don't believe that's a the deepcrawler.
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved