Forum Moderators: open

Message Too Old, No Replies

what to do if GoogleBot not visiting my site?

         

deem0N

9:13 am on Oct 2, 2002 (gmt 0)

10+ Year Member



Hi all.

GoogleBot has visited my site at 5 September.
No one single visit since then :-(

I just changed directory structure on my site at the end of August with mod_rewrite. It was quite deep hierarchy, Now only 2 levels deep.

I see pages with _new_ URLs in www.google.com now. I.e. Google put all
he found before 5 September into the main index. I am happy about it.

But why it stopped crawling the site?

Should I contact google by mail, or just wait another month and see how my site will dissapear from the main index?

Thanks.

bull

9:31 am on Oct 2, 2002 (gmt 0)

10+ Year Member



same here: last real visit on aug 29

but on sept 3, 4 and 21 it grabbed robots.txt and my odp listet dir (dir only) , nothing more. already missing it.

deem0N

9:56 am on Oct 2, 2002 (gmt 0)

10+ Year Member



But I have no single requests from Googlebot, no even robot.txt :-(

Dreamquick

10:38 am on Oct 2, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



If you haven't done so already try re-submitting. At worse a single re-submit will do nothing, at best it will restart the crawling of your site!

I got dropped from google earlier this year due to a routing problem where googlebot couldn't reach my (and quite a few other peoples) site.

In this case all it took was a re-submit attempt to get the googlebot back crawling the site (if I was a guessing man I'd say the 'bot remembers which sites were "properly" inaccessible from the last visit and needs a gentle prod in order to begin re-spidering them again).

- Tony

ciml

10:45 am on Oct 2, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



August 29 and 5 september were both during the last cycle (see the Google Update History [webmasterworld.com]). This should allow you to be in the current index.

To be in the next index, you need to be spidered some time during this cycle.

If the PR is fairly low, and you're not in the Google Directory, then it may be toward the end of the cycle that you get crawled. I wouldn't worry yet.

deem0N

1:38 pm on Oct 2, 2002 (gmt 0)

10+ Year Member



I submitted site to Google and wow!
Bot visited my site right after 2 hours.

It does not mean that my submit helps though.
It may be just normal way of Google life, but with Google you never know for sure :-)

Thanks for hint anyway.

QNetwork

2:35 pm on Oct 2, 2002 (gmt 0)

10+ Year Member



Same problem here. GoogleBot visited my site on September 2, 3 & 4. Crawled a bunch of pages, but not the home page. After that there was no visit. After the monthly update, only the URLs show up. No description. Those pages got PR0. Most of them are dynamic URLs which get the data for the pages from database. This is a new site. September was Google's 2nd month visit. I resubmitted the site twice after the September update. Still no visit. I guess only option now is to wait and see.