Welcome to WebmasterWorld Guest from 126.96.36.199
Forum Moderators: open
I run a very small, very new site, and it's not unusual for Freshbot to take a 2 day hiatus from our site. I just assumed the Net was a really huge place and he had other places to go, and he got back around to be when I reached the top of the pile again...
Other people seem to expect daily multiple FreshCrawls.
a)Am I niave about by abyssmal crawling schedule
b)Are they unrealistic about their assumed daily crawling
c)Are the expectations of a 100 page, 2 month old site and a multiple tens-of-thousand page, decade old site so totally different that I should shut up and go back to lurking?
<don't be afraid to answer "c">
Not sure that anyone can predict the schedule of Freshbot - on my personal site it comes about once every other day and fetches 100 pages. (This is the entire site)
On my works website - it rarely visits and fetches 1-10 pages.
Thing is when you get used to it coming once every 2 days or whatever and then there is a gap you start to worry that it may not come back.