Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Can I get googlebot to index my site on demand?

         

Atharva

12:45 pm on Aug 3, 2008 (gmt 0)

10+ Year Member



Hi,
Usually gbot crawls my client's site once in 3 weeks.

But looking at an upcoming event next month (Sep) we have added and modified content and want google to crawl it ASAP so that by Sep the SERPs reflect the new change.

Gbot just crawled the site last on on 30 jul and we made changes on 3rd aug. is there a way to call gbot today or asap ?

ecmedia

2:31 pm on Aug 3, 2008 (gmt 0)

10+ Year Member



If you have a few websites link to the new pages, G will come rushing to check out the new content.

jdMorgan

4:01 pm on Aug 3, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



...index my site on demand

We can only wish!

You might want to look into setting up a SiteMap (See Google Webmaster Tools in Google's Webmaster Help section). You can declare your "upcoming events" page as your highest-priority page, and indicate that it updates weekly or daily. However, this must be thought of as "a request" and there is no guarantee that Google will fetch the page as frequently as you request.

You might also want to look into strengthening the PageRank of that page (and of your entire site) by seeking (and writing quality content to attract) more on-topic incoming links and by improving your internal linking scheme to make that page more prominent. The higher a page's PageRank, the more frequently Google will fetch it -- regardless of whether you use SiteMaps or not.

Jim

lvkyle

4:03 pm on Aug 3, 2008 (gmt 0)

10+ Year Member



I've noticed the more I update my site blog style, the faster the pages get indexed. I've been having pages indexed that day on google. Perhaps it sees my site as a blog and knows to index it daily.

It also helps to have a sitemap, have no warnings in webmaster tools, and perhaps set high priority for the new pages in the sitemaps.

Atharva

8:22 pm on Aug 3, 2008 (gmt 0)

10+ Year Member



Thanks for those suggestions.
Another thing i did not mention is that the google adsense bot visits almost daily to the site.

Will it provide some hints to gbot that there have been some changes to the site ?

tedster

8:39 pm on Aug 3, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



More than just a "hint". The Adsense bot shares a common cache with regular googlebot in the Google back end. So the answer is yes, your pages only need to be spidered by one of them.

Atharva

7:23 pm on Aug 5, 2008 (gmt 0)

10+ Year Member



Excellent info tedster ... i have seen gbot come in 2 days after changes were made. Looks like daily adsense crawl triggered the gbot ... will keep u updated

eltercerhombre

8:21 am on Aug 6, 2008 (gmt 0)

10+ Year Member



Hi all,

It's not 100% perfect, but when I want Google to crawl my website what I do is to ping both webmastertools and Blog search. Usually it doesn't take more than a few hours to have Google to index the new page.

If I'm right this is due to the Blog Search service, not the sitemap and it works for new pages on the site, not those already published. But haven't tested to be true.