Welcome to WebmasterWorld Guest from 54.145.173.36

Message Too Old, No Replies

How to invite Googlebot to visit more fequently?

still have many bandwidth left for spiders

   
3:41 pm on May 8, 2005 (gmt 0)

10+ Year Member



Checking my awstats daily, i found out that spiders are not visiting my site very often.

For example, this is my stats at March
Googlebot 5236+58 99.64 MB 31 Mar 2005 - 22:49

Is this considered as normal? How many bandwidths are consumed by spiders for an average website? Anyone cares to compare?

1:55 pm on May 10, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Yes its normal for a page with little pagerank. Get some more inbound links and Googlebot might deem your page more worthy of its attention.
10:41 pm on May 10, 2005 (gmt 0)

WebmasterWorld Senior Member billys is a WebmasterWorld Top Contributor of All Time 10+ Year Member



How many bandwidths are consumed by spiders for an average website? Anyone cares to compare?

I'm not sure many folks are going to answer this question as posted. It's like comparing apples and oranges. My site gets around 2,400 page downloads from google each month, but that's enough to spider the entire site three times.

Perhaps you are joking with this post, but the last visit in March was just about an hour before the month actually ended. So there is not much information for people to react to.

Bandwidth is also related to the size of your pages. Looks like an average page on your website is like 18k. If you want Google to eat more bandwidth, try increasing the size of your pages with a large graphics. If you add another 100k of graphics to each page, then Google might use more like 650 MB of bandwidth. But alas, you might lose some traffic to the slow loading pages.

The point is, if you are looking to use bandwidth because you've paid for it, then we can't help. If you want to figure out if Google is spidering your site "normally" then you need to give us more information... for example.

How big is the site?

12:14 am on May 11, 2005 (gmt 0)

10+ Year Member



I have found that Google spiders relative to two aspects - pagerank and quality of links.

I have no idea how Google knows about the quality of links but I have to admit that my sites with a link from, say the BBC, with a lower pagerank get spidered more frequently.

However, in general higher PR = more fresh spidering and deeper crawl.

12:15 am on May 11, 2005 (gmt 0)

10+ Year Member



Should have mentioned in answer to your post - get a link from the BBC, CNN or SKY!
8:06 am on May 11, 2005 (gmt 0)

WebmasterWorld Senior Member sem4u is a WebmasterWorld Top Contributor of All Time 10+ Year Member



You need more quality links that Google knows about. Also, frequently updating your site will help. Google loves fresh content.
10:14 am on May 11, 2005 (gmt 0)

10+ Year Member



Yes, frequently updating the site gets the bot there more often. The more updates, the more often the bot will come back to check for new material.

That said, significant updates, not just changing a couple of words...

10:34 am on May 11, 2005 (gmt 0)

10+ Year Member



Usually, if U click on teh smiley in the google toolbar, the spider comes in a hurry.
4:30 pm on May 11, 2005 (gmt 0)

10+ Year Member



Usually, if U click on teh smiley in the google toolbar, the spider comes in a hurry.

Is this real? So when i add new pages, i keep on refreshing and clicking on the smiley to invite googlebot and adsense bot? And this works?

5:14 pm on May 11, 2005 (gmt 0)

10+ Year Member



Sounds dubious but I did it anyway...

: )

5:10 am on May 12, 2005 (gmt 0)

10+ Year Member



I'm new to this, can you please tell me what is google smiley and I could not find this on Google toolbar?

sweetu

5:28 am on May 12, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Usually, if U click on teh smiley in the google toolbar, the spider comes in a hurry.
I seen nothing that shows this is in fact true, I doubt Google even uses it for anything other than to have more data.

I'm new to this, can you please tell me what is google smiley and I could not find this on Google toolbar?
The smiley face is in the Google toolbar on left side. You can enable it by going in the Google toolbar options and clicking more at the top and you should see a list of things, under web buttons click the checkbox next to voting buttons with a smiley face next to it. The Google smiley face allows you to vote for a web page you are viewing.
6:03 am on May 12, 2005 (gmt 0)

10+ Year Member



Thanks, this information is useful.
5:24 pm on May 12, 2005 (gmt 0)

10+ Year Member



When i add a new page to my site i always click on the smiley and the day after the page is already in da googal :)
5:54 pm on May 12, 2005 (gmt 0)

WebmasterWorld Senior Member tropical_island is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Also, frequently updating your site will help. Google loves fresh content.

Great advice.

We find that it doesn't need much of a change. We have our 2 PR4 and 1 PR5 sites visited daily by the three main bots.

8:50 am on May 16, 2005 (gmt 0)

10+ Year Member



I clicked on smiley 3-4 times for a new blog which I created for my client, but the Google bot never came to crawl.

Is there some other way by which you can get your web pages indexed quickly?

10:52 am on May 16, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Yes, contact their support and tell them about how great your pages are.
12:18 pm on May 16, 2005 (gmt 0)

10+ Year Member



That is the last thing to do, but definitely would like to explore some more ideas before if any?
12:39 pm on May 16, 2005 (gmt 0)

10+ Year Member



"We find that it doesn't need much of a change. We have our 2 PR4 and 1 PR5 sites visited daily by the three main bots. "
yeeh hmmm...:)before Alegra update my site that was desapear had daily visits from googlebot....Until 3 of February...I ruther be worried if I have daily visits...
1:12 pm on May 16, 2005 (gmt 0)

WebmasterWorld Senior Member tropical_island is a WebmasterWorld Top Contributor of All Time 10+ Year Member



I ruther be worried if I have daily visits...

We've had daily visits on these sites for years.

2:46 pm on May 16, 2005 (gmt 0)



"I ruther be worried if I have daily visits"

you should be worried...since you aren't getting daily visits

2:46 pm on May 16, 2005 (gmt 0)

10+ Year Member



Daily visits are good, nothing to worry about, unless of course, you've done something that you are worried about.