If you start adding content regularly, Google will start checking regularly.
I added content earlier today and it was indexed within 3 minutes.
Google's got a new beta program just for webmasters trying to get indexed more completely and faster called sitemaps.
When you set it up, use the suggested free downloadable software if your server supports it, and use the directory crawler option (NOT the log analyzer, unless the new pages are consistently very popular right out of the chute) and set it up to run at least once a day from a daemon process or manually run it daily or each time you make a batch of updates, and configure it to notify search engines. Gbot WILL check your sitemaps.xml within a couple hours and then any new or changed pages (up to a limit of about 50 a day by my estimation) within 24 hours. Seems to work like a charm, at least for an established site like ours. And it saves excess bandwidth by leaving alone most pages you haven't changed.
Google sitemaps work very well. New pages /content getting indexed very quickly for me
You need more Page Rank, not sure if sitemaps factor in Page Rank but I think it will.
Googlebot visits my site every day but it seems not all my pages are indexed. I did a google sitemap thing and all my new pages were in it - but yet they are still not indexed. It's been about a week since I submitted and Google accepted my sitemap.
Links from other pages to your site will help Google bot find its way to your site - and your new pages if your navigation is okay.
I have a couple of sites crawled daily - they have at least PR3 and domains are at least 4 years old. They have natural backlinks from established related sites. When I make a new site, I link to it from one of these old sites. This is enough to get new site crawled daily as well.
I have created a sitemap and the googlebot visits daily....buuuttt, I have a zero pagerank. I have a growing list of backlinks also. I have heard about Google putting you in the sandbox for a few months no matter what you do. Any ideas?
My site is crawled everyday by Google, even did their sitemap thing, but none of the new pages were indexed yet and can't figure on now - since they were added Google has crawled site every day for 2 weeks.
Well, i'll surely try the Sitemap feature of Google.
About the PageRank, How one can find out whats his/her websites PageRank?
And is there any change that a website never get out of Google Sandbox? ~ Just Wondering ~
I hope to get some more reply on the main topic of this Thread.
And lastly thank you all for posting your valuable ideas.
Well, i created a sitemap for my site. its .xml
I chked and i saw Google downloaded it. and status is OK ...
But, my site is not indexed. The links that are indexed are so old. So, Google hasn't indexed links from the sitemap.
So, is it said anywhere that submitting sitemap to Google gurantee you that it will index all your links that is in the sitemap.xml?
Please tell me.
There is absolutely nothing you can do to *make* google index your site at any regular interval. You can only do things that *encourage* it to crawl more often.
Sitemaps will help speed up the process, but only to a point. Sitemaps just let google know what pages you would like to have indexed, and how frequently.
Googlebot has to learn that your site is updated frequently, so she will have to see that it changes every time that she visits. It might take months for her to learn this.
>>>>>>About the PageRank, How one can find out whats his/her websites PageRank? <<<<<
I can't believe no one replied to that, I just now happen to catch it. You install the G toolbar. Then under "view" (in IE) and "Toolbars" you check it, and you can "drag" it where you want. Then click "options" and check the box for "Page rank". You have close the page then go back to it for the PR to be visible. Then hover over the PR area and it will show you. Be sure and uncheck that PR checkbox when you're though, AND disable the entire toolbar since G tracks where you go through the toolbar. Also run AdAware and SpyBot to clear the G toolbar usage tracks.
I've had nothing but trouble with mine for years, since day one when it first came out. I keep disabling it OVER AND OVER again, and the SOB won't go away! Every image I open from my HD has the @#$%&@ toolbar on it! I have to uninstall it, then when I need to check the PR of a page, I have install it again! It also screws up my toolbar on all folders. The best thing is to find a website that will tell you a page's G PR. They are out there if you search for them (of course I can't put the URL of any of them here). I'm SM'ing you a good one that gives current PR, plus PR prediction for "next updates".
Our main sites are indexed daily. If I want newly created pages indexed, I add a text link to my main page, and leave it there until it shows up in the google index. That is normally within 72 hours. It has never failed.
I don't place the page just in navigation, but, that is because our main navigation isn't indexed only the subnavigation is indexed. We have recently set it up that way deliberately, for seo reasons.
The old site navigation was indexed by the engines.
ODP does everything by volunteer editors, and even if you submit a URL to them, thy usually ignore it. That was said by an official dmoz editor in their forumn area. As for Google, I am trying to concentrate on forming reciprocal links now, just hoping their spider finds me soon.
Google did spider my site when I added the URL, but I have not been able to get the bot to come back since. Now, the link I had on Google has vanished altogether.
I think creating a sitemap is the best way to get in the index quick. However, my web host doesn't have Python. I can't afford to buy site mapping software since I only run a little office pool.
[edited by: vitaplease at 5:55 am (utc) on July 11, 2005]
[edit reason] no specifics please [/edit]
First, you are not allowed to self promote here. You should remove your link.
Second, I would not touch a site that says
|That's our pledge to you, and we damn-well mean it! |
Seems a bit unprofessional.
|You install the G toolbar. |
You can pollute your computer with all the spyware you want.
I'll keep using web sites that show page rank like CheckPageRank and avoid the nonsense installed on my computer.
I don't see a way for me to remove the URL from my post. I had read a post somewhere that the spider will pick up the URL in the thread. Sorry if broke a rule, first time here.
I removed the "Damn-well mean it", I guess that wasn't a good way to emphasize it.
Everyone else, disregard my help request for the XML file. I was able to do it myself.