Forum Moderators: open
Saturday also marks the first day with a new version of our site, finally dynamic. The url's have been rewritten so that they appear the same as the old site, however some pages were 'lost' (ie never to return) with the new site.
Now, there are fresh tags out there, so the bot is working, but has there been a noticeable decrease in gbot activity while this update business settles down? Or have we done something wrong....?
We would normally be visited by the 'bot twice every three days.
ie: get many hits from gbot on two separate occasions in a three day period.
It looks like GoogleBot is having a nap... or busy doing something else. :)
She used to crawl a few pages of my sites every day, but I couldn't find any trace in the logs for the last 3 days.
A few other webmasters are facing the same "non-activity".
Dan
Its really casting a pall on the continuous update/freshdeepbot theories.
Its really casting a pall on the continuous update/freshdeepbot theories.
Not so sure that is a theory, I believe that pre-esmeraleda GG mentioned that this was the case - ie it's fact...
Its neither going deep nor enticed by the fresh content of new sites, anyway.
Not sure that it needs to be mentioned, but the fact that one bot is doing what was the work of two is different than the existence of the rolling-update.
GG said that in the future the update as we know it (once a month w/ dances etc.) will change.
However we have already seen freshdeepbot in action during the last deep crawl.
Seems they are having serious problems with the transition to using freshdseep. Mainly missing pages/losing data. I would gladly sacrifice a few fresh visits a week to get ONE solid, reliable crawl.
but there was an observable change in my logs wrt a vanishing gbot, tied with fresh results yesterday that our site is normally part of but wasn't this time, and the fact that we put up a new site just before gbot disappeared.
Put that all together and I needed to know if I either was in 'good company' or up the creek with the redesign.
So I have no clue what's up. It's not spidering the site. Two weeks ago it did the whole site. It generally comes by every couple of weeks and noses around, making sure we're still there, doing most if not all of the site-- I'm not up on the various IP addresses, but we had several different ranges of IP address for them. The whole site's been spidered a million times; I haven't changed anything in months, as I've been working on an entire replacement site (boss finally realized how many inquiries we were getting through our website-- might be good to have more than a glorified brochure up there, no?). That's about to be uploaded, and will be almost entirely different-- but you can bet I'm leaving the old pages in place, with either a link or a redirect to their new counterparts! No way am I taking a chance on Googlebot spidering my new site... it's behaving too oddly!
Most of the visits are just picking up index and robots - most strange, I was getting worried that I had somehow offended the bot but as others are seeing the same thing I'm not too worried - but curious.
Freshbot not doing much but don't you think Google has some other, more pressing concerns at the moment?
mfishy, lets hope G shares your viewpoint.
I also saw the robots file attemped 2 times, about 20 minutes apart, nearly a week ago. That isn't usual.
