- - Google
- -- Google SEO News and Discussion
- ---- Most aggressive crawl I have ever seen.
trillianjedi - 2:15 pm on Feb 23, 2005 (gmt 0)
|they're doing something different in the way they're crawling sites. |
I know exactly what you mean Marcia - I felt the same way about it. Couldn't spot any specific pattern though.
Actually, it looks like old-skool deepbot of about 2 years ago, but with some tweaks. I wonder if they dug some old code out?
Back to a monthly re-index maybe?
Thread source: http://www.webmasterworld.com/google/28237.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com