Forum Moderators: open

Message Too Old, No Replies

googlebot

please explain

         

paisley

11:31 pm on May 19, 2003 (gmt 0)

10+ Year Member



Hi, I have posted on the matter in the past. I took the info and did investigate further. Please offer any help you can on this subject.
I have watched my spider reports over the past 5 years using webtrends. Every month I could tell when the googlebot visited. After a visit my new pages would be updated, and old pages would be gone. That is no longer the case of what I am seeing.
Staring last Nov, the googlebot stopped showing on my reports. After checking everyday, I became concerned, why did it no longer appear.
It was suggested to look at the archieved images of pages of my site to see when each page was cashed. I have been checking this and what I see is each month, about 6-10 pages of our 750 pages get visited. And there is no consistency to which pages are updated in the cashe. There is no deep crawl. No googlebot shows on my reports.
Is there another spider from googlebot that would only visit a few pages each month?
It was suggested to me that possibly there is a problem with webtrends. I have talked to techs about this a number of times. The have told me the googlebot is not visitng my site, or it would show up on the reports.
So I am wondering why and how I correct this so it will visit my entire site like it did for several years.
Is it possible I have been banned in Nov, and still have pages ranked in google? If I have pages that are getting updated, does that mean I am not banned. I am very confused. I have attempted to figure out what is going on.
I installed the googletoobar as it was suggested and some pages show up with the white-green bar and some with the gray bar.
Please give me your input.

jdMorgan

12:55 am on May 20, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



paisley,

As stated in that previous thread [webmasterworld.com] you are going to have to access your raw log files to answer your question. If you cannot access them, and your hosting service cannot provide them, then you need a better hosting service.

It is possible that your stats report package is not aware that Google uses two IP ranges for their 'bots - the ones we call deepbot and freshbot - but it is not likely.

You need to review your raw access logs to answer your questions and to prove or disprove that the googlebots are visiting and that you do or do not have a problem with your stats program.

HTH,
Jim