Forum Moderators: open

Message Too Old, No Replies

any chance for a deep crawl?

         

oliphaunt

11:27 pm on Apr 22, 2003 (gmt 0)

10+ Year Member



Hi, most of my sites just got one deepcrawl this time. Normally 2-3 deepcrawls for each site. Not that I am complaining, but due to a long weekend I was late with optimising and finishing 3 sites.

The freshbots have been there couple of times, but not the deepbot on the new sites.

Any chance, or is it over for this month?

Thanks

oliphaunt

mrguy

11:29 pm on Apr 22, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



According to GoogleGuy,

The deep crawl only started about a week ago so perhaps it will be back for another tasty snack!

Alphawolf

11:49 pm on Apr 22, 2003 (gmt 0)

10+ Year Member



The deep crawl only started about a week ago so perhaps it will be back for another tasty snack!

And/Or...perhaps the freshbot is functioning more like deepbot?

I noticed 1 very large spike in Fresh visits to my site and client sites. Sorta like a deepbot spike.

Could very well just be what I monitor though.

AW

swampy webber

1:46 am on Apr 23, 2003 (gmt 0)

10+ Year Member



Deep still hitting me. It's been sporatic but still here on and off. Good luck.

oliphaunt

3:36 am on Apr 23, 2003 (gmt 0)

10+ Year Member



thanks for the heads up :)

I just looked in the logs and found the deepbot on 2 of my domains, but only looking at the robots and the index file, then going away, coming back doing same thing and 3 hours later the freshbot comes and does the same thing again :)

Maybe it helps: Come on Deepbot, you can make it to my other sites :))

Should I see a doctor?

oliphaunt

Krapulator

3:56 am on Apr 23, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I get the feeling that Deep-bot is approaching retirement age and Fresh-Bot is being groomed for the position.

Jacob_Jans

5:29 am on Apr 23, 2003 (gmt 0)

10+ Year Member



I think that fresh listings are going to start updating on a weekly basis, and freshbot will dig deeper than it use to.

oliphaunt

3:58 pm on Apr 27, 2003 (gmt 0)

10+ Year Member



lucky guy :)

the deepbot has just visited all of my websites.

I already gave up 3 days ago :)

Now I finally can sleep again.

mack

4:10 pm on Apr 27, 2003 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



It certainly had been very on and off this month... dribs and drabs then boom. Ended up taking as many pages as usual plus some new pages. Slow to stat of with then quite a fast crawl.