Forum Moderators: open
I'm seeing multiple fresh crawls every day. No deepbot noticed since 24 April (but then I don't look very deep) :).
In fact, crawl23.googlebot.com, is taking a peek on my
site as I type this.
My site was recently listed in DMOZ. I don't know if there
is any connection? My other two sites have not seen the crawler yet this month.
thx
Is that fresh or deep?
dave
Sure has! I ended up with 5400 yesterday, and 1200 by 8AM today.
Just did some new code on my sites, too- so glad you are getting that!
dave
jtbell: Thanks for the link. I can never remember which IP is which!
Got some nice fresh dates as well at the moment :)
Craig
[edited by: creative_craig at 2:13 pm (utc) on May 15, 2003]
(I wish they'd make them easier to id via dns name or bot id :-)
How do you tell the difference between the deepbot and the freshbot.
The deepbot and the freshbot uses different IPs.
The Deepbot uses IPs which run from 216.*
and the Freshbot uses IPs which start with 64.*
Shak
[edited by: jimun at 3:25 pm (utc) on May 15, 2003]
>>> Does it just verify that the site is there? How long do you guys think I have to be fully indexed, or at least show up on google?
The fresh bot means that Google knows you are there. You will probably see results in the index soon- these will be "fresh" results, and not actually part of the index. Do NOT be alarmed if you see them go away.
The deep bot- which should be arriving soon- is what the "real" index is made from. You *should* be indexed by that... and when those resluts make it to the index, you will be *permenant*.
Not sure of the time frame, but I think this deep crawl will be next months index...
dave
i launched a new site early april. Google came by for about 4 consequtive days..apr. 17th-20rd..didn't list an IP though, just shows up as :
crawl1.googlebot.com
crawl4.googlebot.com
crawl5.googlebot.com
crawl7.googlebot.com
crawl8.googlebot.com
i suspect this is fresh bot sice the site is new and has never been spidered by google before....but the site still hasn't shown up...not even in the fresh results before disappearing and coming back...
what do you think this means?
also...neither freshbot nor deepbot has come by since.
Karl
Me too...the question is, which month? ;-)
First: DO NOT PANIC!
The good news is that Google knows you exist. So celebrate!
Deepbot only comes out once a month, and only for a couple days or so. THAT is what the very next index will be build with.
So what you saw was Freshy... it means Google knows you exist. It also means you should be seen in the index now. HOWEVER- what you see not is NOT permenant, nor is it likely to reflect your final status in Google. In fact, you just MIGHT not be in the NEXT index... that seems to happen a lot. Again, do not panic. You will be in the next one!
So all is good (not that you could do much about it if it was not!)
dave
thank you so very much for u'r response/advice.
greatly appreciated.
