Forum Moderators: open

Message Too Old, No Replies

Googlebot question?

         

PPCguy

5:12 pm on May 17, 2005 (gmt 0)

10+ Year Member



I was looking at all my logs for the sites on my server. I noticed that on a site I never did any marketing or promoting on has had googlebot crawl it over 200 times so far this month. I mean this is a site that only get about tens unique visitors a day.

What's even stranger was last month it was only crawled 50 times by the googlebot.

And the month's before that the googlebot only came twice a month.

So it would seem something got the googlebot coming to my site last month.

This is a site I never touched or marketed. Heck one of my "active" sites I was pushing hard only had the googlebot come by only 137 times last month, it this is a site that get about 400 unique visitors a day.

Yet I got this dormat site with no visitors and the googlebot came by 247 times?

How is that possible?

wilderness

1:25 am on May 19, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



PPC,
I believe both you and others in this fourm are confused by what you have presented?

I'm going to attempt to tear some issues apart and hopefully others will jump in and assist?
Once you have cleared up the confusion.

googlebot crawl it over 200 times

Do you mean that you have a TOTAL of 200 log entries at different intervals or that you have 200 COMPLETE crawls of ALL your website pages by google?
If the latter?
That's very unusual!

last month it was only crawled 50

If the bots enjoy the diet that you feed them? Hopefully they will crawl more pages (and deeper in your directory structure) on each new and overall crawl.

My larger site is approximately 800 pages (which by some standards is very small) and there were times when google was crawling each and every page four times monthly.

Recently they are comparing changes made in page that google has cached and crawling new pages that the bot missed for nuerous reasons (one being the page previously didn't exist) on the previous crawl.

Pesoanally, I don't pay much attention to the google bot in my logs, with the exception of occasioanlly verifying the IP range is in fact google and not some other IP range using a fake IP.
Google has been very good to my pages and has more than a fair share listed under multiple categories.

Google is just as fair and active with my second and smaller site. The content of that site is similar to my larger site, however presents a different variation of both content and materials along the same overall subject.

All it takes if for the google bot to find your site (by a link) and they will crawl.

I'm sure your inquiry and the reason is in inderstanding the methods, however sometimes it's just not possible.

Webmaster World does have multiple forums primarily for Google:
[webmasterworld.com...]
[webmasterworld.com...]
[webmasterworld.com...]
[webmasterworld.com...]
[webmasterworld.com...]
[webmasterworld.com...]
[webmasterworld.com...]
[webmasterworld.com...]

Somebody there may be able to assist you better.

Don