Forum Moderators: open

Message Too Old, No Replies

general googlebot inquiry

a googlebot visits every day, but....

         

Huge1102

4:20 pm on Feb 18, 2004 (gmt 0)

10+ Year Member



Hey guys,
I'm a newcomer to google optimization, but I think I'm on the right track. I have a site that has been google optimized for about two weeks now. I started getting googlebot visits about 3 or 4 days after going "live". I've had the same bot visit my site every day since then (Googlebot/2.1 (+http://www.googlebot.com/bot.html). Last night it stopped by twice.

I haven't gotten a deep crawl yet (only my homepage is indexed). My question is this:
How long should I expect to wait for a deeper crawl and how long should I expect to wait for an PR update (if any) on the google tool bar.

Any and all feedback will be appreciated.

Hugo

Huge1102

11:53 pm on Feb 21, 2004 (gmt 0)

10+ Year Member



Update:

The googlebot has stopped visiting my site for three days now. I have no idea why. The only change that I have made was adding more reciprocal links (no link farms or penalized sites). I update my site at least once or twice a week, and my code has been validated at W3.

Can someone please share similar experiences or give some insight as to what might have caused googlebot to stop coming to my site. Should I be worried, or should I just keep plugging away adding inbound links and content as usual.

kamikaze Optimizer

12:10 am on Feb 22, 2004 (gmt 0)

10+ Year Member



googlebot visits my site everyday, but still on page
100000..pay ink, forget the google lottery

Mardi_Gras

12:15 am on Feb 22, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



>Should I be worried

No.

>should I just keep plugging away adding inbound links and content as usual.

Yes.

MedCenter

2:09 am on Feb 22, 2004 (gmt 0)

10+ Year Member



Googlebot will crawl your site deeper if you have inbound links, and more often.

Googlebot crawled 2000 pages of our site 2 weeks after launching, but we already had our link on plenty of websites.

jonknee

2:15 am on Feb 22, 2004 (gmt 0)

10+ Year Member



If you only update or your site once or twice a week, there is no reason for the Googlebot to visit more than once per week. Just wasted money (in bandwidth) for Google.

Expect a deep crawl soon, as long as you have some incoming links. It has never taken long for me.

Net_Wizard

6:07 pm on Feb 22, 2004 (gmt 0)



Since this is a googlebot general inquiry, I thought I might add this...

Googlebot is definitely 'submitting forms' not only following the action part of the forms but executing it.

So I search Google for 'Googlebot forms' just to verify my suspicion and I found this google cache [216.239.37.104...]

This is not good.

Need3lives

7:04 pm on Feb 22, 2004 (gmt 0)

10+ Year Member



Same boat. Googlebot visiting daily, and fresh tags on index, but only index page in the rankings. About 65 pages on the site, and new content added daily. Several inbound links.

It has been like this for about a week - I am guessing it will eventually index the rest of the site... will see.

Huge1102

8:49 pm on Feb 22, 2004 (gmt 0)

10+ Year Member



Update:

My main concern is not that googlebot hasn't stopped by in a few days. What worries me is that my homepage was indexed, and now it is not. Why would google go through the trouble of removing my homepage from the index completely? Does that mean that I've been penalized or black balled?

Has this happened to anyone else, and if so, did your site get reindexed when the googlebots came back?

Please respond.

Jackie

10:02 pm on Feb 22, 2004 (gmt 0)



Google's been a bit strange the last 7 to 8 days since the last update started. I also had a new site added and then dropped and then back again.

With most Google questions, the answer is patience.

SunnyDaze

11:42 pm on Feb 22, 2004 (gmt 0)



FTR: G may index your site after a gbot visit. That does NOT mean your site contents will show up in the SERPs - although your front page usually does in a very short period of time. The indexed pages generally sit in limbo until G has a refresh of content - to my guess every 3 to 4 weeks and then content starts appearing in the results. PR will usually begin to gain ranking at the same time.

Just do the do - build them pages; add content and keep at it - G gets there eventually. The gbot visits has never really altered our PR or amount of pages in the SERPs until the refresh happens on a large scale. The daily gbot visits seems to effect well placed pages that are already in the SERPs - perhaps pull you up a spot or two or drop you back a bit. But never anything dramatic outside of a major update!

This has been my experience for many months with both new small sites and large content sites.

8>)Sunny