Welcome to WebmasterWorld Guest from

Forum Moderators: open

Message Too Old, No Replies

Googlebot doesn't visit anymore...

Visits fallen from 5000 to 150



4:59 pm on Aug 27, 2003 (gmt 0)

10+ Year Member

I'm worried sick now...
I just had a good look at my logs and Googlebot doesn't stop by anymore to crawl my site. In July I had 5000 visits, in August 150 (!). I don't know why. I did change navigation, but only slightly and after visits were low already. The site is a webzine and pages are added on a regular basis. I can't figure out what to do to entice the bot to visit more often again. My PR was and still is 5.

Anyone here any idea how to stimulate the bot to visit again?


6:44 am on Aug 28, 2003 (gmt 0)

WebmasterWorld Administrator mack is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

I wouldent panic yet!

Sometimes we all have months with less Googlebot activity than we woudl like, Have you perhaps had some down time that may have coincided with a Google visit?

Last month my site was in a slightly similar situation. It started off really slow then picked up towards the end of the month. I think Googlebot is getting pretty smart at working out when your site is likely to change. If your server is using the "If_modified_since" header then this may cause Google bot only to index new content.

Try and not worry to much about bot visits. Has it effected your referals or have they remained the same.

Hope it works out.



7:11 am on Aug 28, 2003 (gmt 0)

10+ Year Member

same thing here


8:13 am on Aug 28, 2003 (gmt 0)

10+ Year Member

Lots of changes in googlebot behavior for everyone lately. Nothing to worry about though, it will all work itself out soon.
One of my sites was getting fresh tags every day for about 2 or 3 weeks. With deepbot activity every 2 weeks. A couple weeks ago I stopped getting fresh visits but i get deep crawls and updates at least once a week.
I almost always make a few subtle changes and additions to most of the pages on this site every day.
Today I made more changes than usual and played around with my "alt" tags and my text links and was NOT suprised to see google deepbot visit all of the pages i worked on.
Hope this helps somehow.


8:17 am on Aug 28, 2003 (gmt 0)

10+ Year Member

How many new links on the web have you aquired in the last 2 months which point to new content?


8:51 am on Aug 28, 2003 (gmt 0)

10+ Year Member

As i mention, google is deepcrawling my site currently, as i post this.
I went and placed a good text link to your homepage on an appropriate page of my site. The page only has 3 outbound links. If you've added new pages and content googlebot will hopefully go deeper than your homepage.
Let me know with a sticky if this does anything for you, i'd would simply "like to know".


12:41 pm on Aug 28, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

I just had a good look at my logs and Googlebot doesn't stop by anymore to crawl my site.

When you speak of visits it sounds like you talking about googlebot, not visitors. How's the traffic been?
Are new pages getting picked up?

[edited by: MrSpeed at 3:09 pm (utc) on Aug. 28, 2003]


1:21 pm on Aug 28, 2003 (gmt 0)

10+ Year Member

First of all, let me thank all of you people for the response to this post. It's been a great support. I keep an eye on this forum and therefore knew Google is acting as if it were a chameleon, but there are a few things that worried me.

For example, although I do add content--about a page per every three days (yes, during holiday season too)--the bot doesn't index it. My people's traffic has dropped to about 10% of what it was previously with MSN, now most important SE and Google only third place--used to be 1st place. When I look for the keywords I've used to optimize and which reflect what the site has on offer, I used to get #1 to 30 positions depending on the keyword. Now I'm nowhere near those anymore.

In June, when bot-visits and traffic was still high, I decided to use an invisible first paragraph (CSS: display=none) with some sentences (not single words!) describing what the site covers. On each page (well, sort of, some pages duplicated this paragraph) I used a different description with the same message (description of the site's content) in one sentence, and then a bit of an elaborate description of what is on the page (I used more keywords than in the running body text; using them in a journalistic article looks a bit odd to me) in another sentence. I've since (early August) removed these invisible div's as I saw no difference in the SEs that pay attention almost solely to content anyway. Last week, in a futile attempt to get G to visit me again, I have located the HTML-code-and-content of the first paragraph right below the body tag--with the CSS absolute positioning it doesn't make a difference for the visitor anyway (except for the 0.01 percent of older browsers that visit--ah, well, you can't win them all).

Also, it can't be that Google has penalized me, because using the tools7.com pagerank service (I'm on a Mac and haven't the pleasure of running the Google toolbar) tells me my PR is still at 5. My DMOZ listing of two weeks ago doesn't get in either--if it had, I would really be worried sick...

Another thing that strikes me as odd: I've posted an interview that immediately was linked to by 200 other sites. Those 200 inbound links are not reported by Google at all. G reports 19 links only--even without the 200 extra, I should be reported as having 50 inbound links (I follow them up...). For a while I was thinking Google perhaps was now into themes: the interview that I posted was only sideways related to the main topics on the site (it relates to the OS used by the target group).

onedumbear, I will certainly keep you posted of changes in indexing behavior by sticky--a BIG thanks for trying to help me this way!


11:37 pm on Aug 28, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

I saw a similar reduction in googlebot DEEP visits on our twice weekly webzine too. It was accompanied by a drastic loss (75%) in backlinks to our homepage as well. PR dropped one rank for a month or two and just recently returned to where it had been previously with about the same final(75% reduced) backlinks.
Has anyone noticed if visit frequency is in any way related to PR? i.e. higher PR = more frequent visits?
We had a page which almost never changed (maybe every other month max), but as soon as it changed from a PR4 to a PR5 because of more outside links, it started being visted almost every single day and never less than every 36 hours. Consider if google finds your URL on 50 backlinks each of which are crawled once a month on a random basis, doesn't that mean it should follow the link to your page to crawl it too?

Featured Threads

Hot Threads This Week

Hot Threads This Month