Forum Moderators: Robert Charlton & goodroi
The google bot is coming to the site looking at a couple of pages then dissapearing. I've tried site maps but they don't seam to be helping.
Any advice out there as the client is getting a bit pissed
Cheers
Sid
[edited by: lawman at 9:38 pm (utc) on April 5, 2006]
[edited by: tedster at 12:36 am (utc) on April 8, 2006]
[edit reason] add link to related thread [/edit]
but i have found some sites that are still doing well in google....
another idea we have is competitors are using the adsense ads to complain about your sites..... "ads by google"
or this could be based on the lawsuits and google is cleaning out the databases...
Just shows us, don't depend on one searchengine.... make a site sticky and visitors will return without an engine.
Remember the "New Coke" and the "Classic Coke" days? :) Bring back the original! :D
but there is a good post in here.... about making a site that people visit no matter what...
the way you should look at your site is from word of mouth traffic and any search engine traffic is just gravy, if you rely on search engine traffic alone you are going to stress big time.
Has anyone tried the "Google Sitemaps" feature? I wonder if google is cleaning up the databases, and using this as a way to push publishers into using the sitemaps.
Any other suggestions?
As a matter of fact, things across the board (including DC activity) are incredibly slow today ...
Totally White hat, with some link exchanges for traffic purposes, nothing fancy, no paid links in, or out.
Both sites have hand written html site maps(not google site maps),
Each are hosted on different hosts, only one site links to the other, they are totally non-related.
Each has different whois info.
Only thing they have in common really, is me.
One site is 2 months old, the other is 3.5 years old.
Both show up in the Serps, and the 3.5 year old is doing quite well at the moment, recieving traffic on over 1,000 different keyword combos a day, but I am getting concerned a bit with the lack of googlebot activity. This is the least googlebot activity in over 3 years.
I had to post to let other know, there are us lurkers out there who also are having this issue. For every webmaster who reports this issue, there may be many more who do not bother to post, and a MUCH greater number who do not know that Gbot has stopped visting their sites.
IMHO this might a much more widespread issue than is being reported.
Back to Watching
WW_Watcher
So, in our case, the Googlebot is still coming regularly, it's just that it only takes one or two pages at a time instead of the usual 20-30. Every now and then it perks up for a couple of hours and takes 10 pages at a time (but only for short bursts).
This is pretty close to my experience. None of the sites have any significant changes (I own the hosting company and haven't changed any servers, IPs or configurations); most sites are over two years old, a handful are over four or five years old. Everything pretty much seems to have stopped around March 28/29. The site report charts for that period show a DRAMATIC drop off for all my larger sites - down from 400-700+ pages a day per site to 30 tops now. What's more, as near as I can tell, they are picking up the same 30 pages each time, and not touching any of the others. Most of my sites have Google Sitemaps, but not all, so there's no similarity there. A few of them are in supplemental hell now. I can usually get a new site into the index within a week, even if it doesn't rank. I haven't been able to get a visit from a Google spider for a new site since the end of March either; I've added maybe 8 since then. All in all, it's kind of a mess.
do you use a dmoz dump? or a directory for your links?
No, just hand-written html for all the outgoing links.
You mean you look at the date in google cache to see if there are new updates?
Rather unusual to have absolutely no change whatsoever in a days time ...
It's the Mozilla-Bot that is currently crawling at a pace that would take several years to index a moderately sized website.
I have also noticed something peculiar, in that google referrals (as noted in my logs) on any given site go to almost 0 while Mozilla Googlebot is running full bore on that particular site.
Site 1; Mozilla Bot running better than ever, old Bot unseen, new pages crawled and indexed and In SERPs within 48 hours max. Oldest site I have. Whitehat. (please take on me on my word - dont want to get into a long discussion on whether I know what I am talking about.)
Site 2: Mozilla Bot comes occasionally (once in 3 days or so), crawls the main section pages within the site and homepage, and doesnt display their updated versions in the cache. Mostly dead. Whitehat, not too old site. No sandbox.
Site 3: Mozilla bot crawling new pages regularly. But the pages dont even enter SERPs. Crawled, but invisible in index. Whitehat.
Have no idea what to make of all this.
If you take [72.14.207.104...] as the index excluding Supplementals on the site searches then even pages that have been crawled relatively recently are not being retained in the index.
I notice the symdrone too. The index pages are losing fast and the cache is about 3 weeks old.
what do you mean... in line with their guidlines on the google site?
Everyone Else... I'm actually thinking that google is looking at search results, then where the user clicks, and finally if the user leaves through an adsense ad....
this saying that the page wasn't as good as a result compared to the ad... type of deal...
If you think about it they can pass a cookie to the searcher, then the adsense ad would pick it up and see how long the user stayied on the site....
Just another thought....
Make sure your pages are within googles guidelines! I had the same thing happen to me and I fixed the meta tags and they reappeared a week later.
What did you find wrong with your meta tags? I was under the impression that Google really doesn't pay a lot of attention to them anymore.
So the spider i see identified simply as Mozilla 5.0 IS Google now?
