homepage Welcome to WebmasterWorld Guest from 107.20.37.62
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

    
How to invite Googlebot to visit more fequently?
still have many bandwidth left for spiders
sirkei




msg:737823
 3:41 pm on May 8, 2005 (gmt 0)

Checking my awstats daily, i found out that spiders are not visiting my site very often.

For example, this is my stats at March
Googlebot 5236+58 99.64 MB 31 Mar 2005 - 22:49

Is this considered as normal? How many bandwidths are consumed by spiders for an average website? Anyone cares to compare?

 

mrMister




msg:737824
 1:55 pm on May 10, 2005 (gmt 0)

Yes its normal for a page with little pagerank. Get some more inbound links and Googlebot might deem your page more worthy of its attention.

BillyS




msg:737825
 10:41 pm on May 10, 2005 (gmt 0)

How many bandwidths are consumed by spiders for an average website? Anyone cares to compare?

I'm not sure many folks are going to answer this question as posted. It's like comparing apples and oranges. My site gets around 2,400 page downloads from google each month, but that's enough to spider the entire site three times.

Perhaps you are joking with this post, but the last visit in March was just about an hour before the month actually ended. So there is not much information for people to react to.

Bandwidth is also related to the size of your pages. Looks like an average page on your website is like 18k. If you want Google to eat more bandwidth, try increasing the size of your pages with a large graphics. If you add another 100k of graphics to each page, then Google might use more like 650 MB of bandwidth. But alas, you might lose some traffic to the slow loading pages.

The point is, if you are looking to use bandwidth because you've paid for it, then we can't help. If you want to figure out if Google is spidering your site "normally" then you need to give us more information... for example.

How big is the site?

Swanson




msg:737826
 12:14 am on May 11, 2005 (gmt 0)

I have found that Google spiders relative to two aspects - pagerank and quality of links.

I have no idea how Google knows about the quality of links but I have to admit that my sites with a link from, say the BBC, with a lower pagerank get spidered more frequently.

However, in general higher PR = more fresh spidering and deeper crawl.

Swanson




msg:737827
 12:15 am on May 11, 2005 (gmt 0)

Should have mentioned in answer to your post - get a link from the BBC, CNN or SKY!

sem4u




msg:737828
 8:06 am on May 11, 2005 (gmt 0)

You need more quality links that Google knows about. Also, frequently updating your site will help. Google loves fresh content.

Pico_Train




msg:737829
 10:14 am on May 11, 2005 (gmt 0)

Yes, frequently updating the site gets the bot there more often. The more updates, the more often the bot will come back to check for new material.

That said, significant updates, not just changing a couple of words...

tarr74




msg:737830
 10:34 am on May 11, 2005 (gmt 0)

Usually, if U click on teh smiley in the google toolbar, the spider comes in a hurry.

sirkei




msg:737831
 4:30 pm on May 11, 2005 (gmt 0)

Usually, if U click on teh smiley in the google toolbar, the spider comes in a hurry.

Is this real? So when i add new pages, i keep on refreshing and clicking on the smiley to invite googlebot and adsense bot? And this works?

Pico_Train




msg:737832
 5:14 pm on May 11, 2005 (gmt 0)

Sounds dubious but I did it anyway...

: )

sweetu




msg:737833
 5:10 am on May 12, 2005 (gmt 0)

I'm new to this, can you please tell me what is google smiley and I could not find this on Google toolbar?

sweetu

robotsdobetter




msg:737834
 5:28 am on May 12, 2005 (gmt 0)

Usually, if U click on teh smiley in the google toolbar, the spider comes in a hurry.
I seen nothing that shows this is in fact true, I doubt Google even uses it for anything other than to have more data.

I'm new to this, can you please tell me what is google smiley and I could not find this on Google toolbar?
The smiley face is in the Google toolbar on left side. You can enable it by going in the Google toolbar options and clicking more at the top and you should see a list of things, under web buttons click the checkbox next to voting buttons with a smiley face next to it. The Google smiley face allows you to vote for a web page you are viewing.

sweetu




msg:737835
 6:03 am on May 12, 2005 (gmt 0)

Thanks, this information is useful.

tarr74




msg:737836
 5:24 pm on May 12, 2005 (gmt 0)

When i add a new page to my site i always click on the smiley and the day after the page is already in da googal :)

Tropical Island




msg:737837
 5:54 pm on May 12, 2005 (gmt 0)

Also, frequently updating your site will help. Google loves fresh content.

Great advice.

We find that it doesn't need much of a change. We have our 2 PR4 and 1 PR5 sites visited daily by the three main bots.

sweetu




msg:737838
 8:50 am on May 16, 2005 (gmt 0)

I clicked on smiley 3-4 times for a new blog which I created for my client, but the Google bot never came to crawl.

Is there some other way by which you can get your web pages indexed quickly?

SEOPTI




msg:737839
 10:52 am on May 16, 2005 (gmt 0)

Yes, contact their support and tell them about how great your pages are.

sweetu




msg:737840
 12:18 pm on May 16, 2005 (gmt 0)

That is the last thing to do, but definitely would like to explore some more ideas before if any?

cat5




msg:737841
 12:39 pm on May 16, 2005 (gmt 0)

"We find that it doesn't need much of a change. We have our 2 PR4 and 1 PR5 sites visited daily by the three main bots. "
yeeh hmmm...:)before Alegra update my site that was desapear had daily visits from googlebot....Until 3 of February...I ruther be worried if I have daily visits...

Tropical Island




msg:737842
 1:12 pm on May 16, 2005 (gmt 0)

I ruther be worried if I have daily visits...

We've had daily visits on these sites for years.

walkman




msg:737843
 2:46 pm on May 16, 2005 (gmt 0)

"I ruther be worried if I have daily visits"

you should be worried...since you aren't getting daily visits

Pico_Train




msg:737844
 2:46 pm on May 16, 2005 (gmt 0)

Daily visits are good, nothing to worry about, unless of course, you've done something that you are worried about.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved