Forum Moderators: open

Message Too Old, No Replies

How Do I Invite Googlebot?

No visits from googlebot in my logs

         

kriskd

2:29 pm on Sep 6, 2003 (gmt 0)

10+ Year Member



I run a PR4 site and enjoy checking my logs for the site. I have never had a googlebot visit. I use the robots meta tags and have them set for index and follow.

My mom who uses the sames hosting service as I do (so I know how to check her logs!) runs a PR5 site and has googlebot all over it! The only meta tag she uses is the keyword tag. I should probably get on her about adding a description tag, but that's a different story. :-)

Any thoughts? Any additional info I need to provide to get some ideas on why googlebot isn't visiting my site?

Thanks,
Kris

hlbuss

8:11 pm on Sep 6, 2003 (gmt 0)

10+ Year Member



I don't get how you could have a PR 4 site and no googlebot visits. Google needs to index your site to give it a PR, therefore they need to visit it. Your site is listed in Google, correct? The PR 4 isn't just some temporary estimate thing caused by being in the subdirectory of a major site/host?

To get Googlebot to visit your site, you need links from other sites. Concentrate on getting other sites to link back to yours, possibly by trading links.

As far as the robots meta tags, I would just toss them. I don't think they do any good, and I'm sure some people here will agree. It may not be a bad idea to get your mom a description tag, though, as they can help a little. :-)

I guess I'm kinda confused...no googlebot = no PR, yet you have PR. Hmmm. Are you sure you didn't miss a bot visit or two?

jcoronella

8:12 pm on Sep 6, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Googlebot will visit your site if you put your url into your profile and then post a message asking GoogleGuy to send the bot.

or you can just make sure you have an incoming link and some patience

Googlebot will also visit urls posted here [google.com] ;)

kriskd

9:33 pm on Sep 6, 2003 (gmt 0)

10+ Year Member



I am confused as well.

I went back and checked my stats month by month just to make sure I didn't miss a visit. I did a search for "googlebot" and came up empty each month.

Then I did a search on my mom stats. She had 8 visits by googlebot in August and 4 so far in September.

I use the Google toolbar and that says I have a PR4. However, my PR4 ranking is relatively new.

Even before I got the PR4, I was always pleased about my ranking in the search engines especially Google. Even the strangest search terms brought up my site as #1.

That in itself is kind of nice because I don't spend anytime trying to submit it to search engines anymore. Talk about a time saver!

Also, I do have some good incoming links as noted when a run a marketleap report. My mom's page does have a lot more incoming links, however. Thus her higher PR.

Jcoronella, I do have my URL in my profile and who is googleguy?

Perhaps more patience is required before I start seeing googlebot in my logs?

Thanks again,
Kris

PatrickDeese

9:49 pm on Sep 6, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



why don't you get your mom to link to your site? If she is getting googlebot, a link to your site will bring GB to yours.

jcoronella

9:58 pm on Sep 6, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I do have my URL in my profile and who is googleguy?

Sorry KriskD, that was a joke (as was the link to the spam report) GoogleGuy is a google employee (or several) that hangs out here and solicits spam reports from people.

Patrick is right, a link from a PR 5 will bring googlebot around in a matter of days. Having a PR 4 itself should bring googlebot around at least once a month.

kriskd

10:02 pm on Sep 6, 2003 (gmt 0)

10+ Year Member



Jc,

I read through your link to the spam report and of course stayed away from submitting my site to that!

Mom was one of the first people to link to me, and I could tell immediately her PR5 site helped me out. Pretty good for a 62-year-old woman, huh? :-)

Since my PR4 is relatively new, perhaps I'll be seeing more of googlebot in September.

Thanks guys!

Kris

Hardwood Guy

10:07 pm on Sep 6, 2003 (gmt 0)

10+ Year Member




Googlebot will also visit urls posted here ;)

Any idea when they take action on the bad boys? I tried to start a post that apparently wasn't approved about five days ago. My question was..

I know of one site that uses a boatload of hidden text and they also have sponsered(paid)links with google. Is money playing a role here? Sure wish someone could answer this one:)

martinibuster

10:16 pm on Sep 6, 2003 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Pretty good for a 62-year-old woman, huh?

Umm... Do you mean to say that older women are otherwise useless, helpless, and clueless?

Tell that to Hillary Clinton, Barbara Boxer, Elizabeth Dole, Carly Fiorina, Barbara Walters, Martha Argerich, etc...

kriskd

10:23 pm on Sep 6, 2003 (gmt 0)

10+ Year Member



Martinibuster,

As a 32-year-old woman, I can hope I will still be as quick minded and sharp on the computer as my mom. I meant those words with the utmost respect for my incredibly intelligent mother and others just like her.

Thanks, Mom, for sharing my interest in web page creation and the Internet in general. It always makes for interesting and educational conversations.

Kris

div01

11:35 pm on Sep 6, 2003 (gmt 0)

10+ Year Member



kriskd,

One of my sites has the exact same problem. It has been spidered by Googlebot months ago, hence the PR4, but I haven't seen any sign of the bot in ages. This site was started in April of this year...and with all that's been going on with Google this year, I don't know what the problem is.

kriskd

11:38 pm on Sep 6, 2003 (gmt 0)

10+ Year Member



div01,

Thanks for sharing your thoughts. My site started in June. I imagine in time googlebot will start showing up!

Kris

Gus_R

11:40 pm on Sep 6, 2003 (gmt 0)

10+ Year Member



With pr4 you should have freshbot visiting your index page everyday. (?)
Get new links and fast you will see it in logs.

martinibuster

12:21 am on Sep 7, 2003 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



As a 32-year-old woman, I can hope I will still be as quick minded and sharp on the computer as my mom.

As a 40 year old man who can't remember where he was two weeks ago, I have a slim chance of being that quick by 62!
;) Y

Now if I can only remember where I left my rascal [abervegas.com]...

twilight47

12:35 am on Sep 7, 2003 (gmt 0)

10+ Year Member



If you want a crawl, some say that clicking the ;) happy face on the Google toolbar while viewing your page will bring a bot to an uncrawled page.
Just don't click the :(

martinibuster

12:38 am on Sep 7, 2003 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Gbot is on a different update schedule for different sites. Some say that the determining factor is pr, while others say the frequency of changes plays a role.

One thing is fairly certain:
There's a daily, weekly, and a 3-4 week update schedule.

SlowMove

12:44 am on Sep 7, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I got Googlebot to fully index a site within 48 hours by filling out guestbooks, and that was done recently. But those are garbage links, and I'd never do it again.

A really good way to get quality links for your site is to find sites that are similar, and type in "link:URL" at Google. Google will only show PR4+ pages that link to the sites.

kriskd

12:44 am on Sep 7, 2003 (gmt 0)

10+ Year Member



I click on the happy face occasionally. However, I did once accidentally click on the sad face while viewing my page! I tried to correct it by giving it several happy click immediately following.

I guess I wonder how much value those buttons really have.

Kris

PatrickDeese

12:59 am on Sep 7, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



The "vote" buttons make your computer go beep, if you have your speakers on.

That's all they do.

Arnett

2:47 am on Sep 7, 2003 (gmt 0)

10+ Year Member



Google tends to like sites that recieve regular content updates. Keep tweaking your site. Modify some text,especially the title. What you want to do is attract the "Freshbot". Look for a date beside your listing in Google. It means "recently updated" and is called a "fresh" listing. If you keep working and keep the bot coming back,the date beside your listing will change. The bot may keep coming back every day for a while. If you stop working on the site the bot will stop coming and the date will disappear again.

The frequency of page updates seems to depend on PR. A PR4 will get updated monthly. Higher PR sites get more frequent updates. Under pre-Dominic Google pages with a PR of less than 4 seemed to get updated every three months.

DON'T trust the toolbar for accurate indication of current PR. I'm told that it isn't right yet.

kriskd

11:28 am on Sep 7, 2003 (gmt 0)

10+ Year Member



It's interesting, I seem to be doing everything right and I still don't see googlebot in my logs.

As for the latest suggestion, my web page content is updated frequently. As of right now, it has been couple days now -- Thursday was my last update, but I will be doing some moderate changes (versus major) today.

As far as the toolbar being inaccurate, I sure hope my PR isn't actually less than 4!

Kris

jcoronella

1:46 pm on Sep 7, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



One thing is fairly certain:
There's a daily, weekly, and a 3-4 week update schedule.

I'm seeing EXACTLY 3 weeks in my logs. This is the first I've heard someone else post this observation.

johnnydequino

2:03 pm on Sep 7, 2003 (gmt 0)

10+ Year Member



Not sure if this has been mentioned, if you enter your domain name, say widgets.com in the toolbar search area, googlebot will visit for sure that day or the next.

When I started a new site, I had no visits from googlebot for the first week. I learned about this trick, submitted everyday for a week just once, it came every day and on day 7 spidered all the pages.

jd

Hardwood Guy

2:16 pm on Sep 7, 2003 (gmt 0)

10+ Year Member




Not sure if this has been mentioned, if you enter your domain name, say widgets.com in the toolbar search area, googlebot will visit for sure that day or the next...

Doesn't hurt to try it. That would be a cool trick..anyone else?

mcavill

2:46 pm on Sep 7, 2003 (gmt 0)

10+ Year Member




Not sure if this has been mentioned, if you enter your domain name, say widgets.com in the toolbar search area, googlebot will visit for sure that day or the next...

Check msg 3 of this thread: [webmasterworld.com...]

tbear

12:53 am on Sep 8, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Well, seems to me that Googlebot HAS been around your site since you appear in the serps.....
But I would concentrate on getting (maintaining) your site's quality and not worry about bots unless you DON'T show in the serps.

martinibuster

1:09 am on Sep 8, 2003 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



One thing is fairly certain:
There's a daily, weekly, and a 3-4 week update schedule

I'm seeing that from logs and updates to a variety of sites. At the recent San Jose SES conference one of the Google Panelists mentioned this exact schedule, which confirmed to me what I was already seeing.

She confirmed this in the context of a question about database freshness. There was someone else there, a blonde fellow, I don't know who he was, who asked a follow-up question using jargon you can only learn here at WW, and she declined to answer because the question involved too many specifics.

In retrospect, for someone with as much knowledge as he had, it was pretty lame/naive to ask a question about specifics.

Hey, that person was at several forums that I attended, asked fairly sophisticated questions at each (albeit naive), but has yet to pipe up here at WW. Some people share, some don't.

Key_Master

1:20 am on Sep 8, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



[google.com...]

kriskd, are you using server logs or using JavaScript to track visitors?

chiyo

1:35 am on Sep 8, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



jcoronella wrote >> GoogleGuy is a google employee (or several) that hangs out here and solicits spam reports from people. <<

Is that another joke? Or if its not its a very narrow view of googleguys role here. From memory when googleguy started hanging out here a lot WebmasterWorld was deluged with "spam reports" from posters in the hope that Google would ban a competitor.

I got the impression (though maybe im wrong) that the spam report URL was provided as a way for people to do this off-board so the amount of spam reports on the actual board would be reduced to almost nothing. In the early stages both moderators and googleguy publicized the URL, to reduce the strain on the board.

Its possibly a little unfair if the above is correct to accuse googleguy of over- encouragement of spam reporting. It just transfers the problem to google rather than WebmasterWorld which is fine by me!

jcoronella

2:00 am on Sep 8, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



martinibuster: Thanks. I knew I should have attended SES. Tonight is the night for that major update - good luck to us all.

Chiyo: I am almost always joking. Humor, not ire, intended.

This 44 message thread spans 2 pages: 44