How to get my pages indexed

indexed google page

[stevegpan2]

Hello masters,
I have a site pr4. Even though I put 26 links on the index page try to get these linked pages indexed. But Google seems did not index these pages.
These pages are 2 levels down from file directory, like /auth/a.html. If I put 1 level down, will that help?

Can someone shed some lights on how to make these 26 linked pages indexed?

I have another site with PR5, Will it help if I put them on the pr5 site?

Regards,

[Birdman]

When did you place these links? It can take up to two(2) months to get pages indexed.

[stevegpan2]

Birdman,

Thanks for your quick reply.
Does Google update every couple of days for some pages?
I notice Google says my index page modified on 4/28/2003 and the cache has the new changes I made around 4/28/2003.

Is that only high PR pages get updated more often?

Regards,

[ncsuk]

All pages will be updated when freshbot comes assuming that it.

a. finds them
b. likes them
c. decides there is something useful on them

Needless to say make sure that all the links are right and the pages are correctly formatted as if they are not it can have a detrimental effect.

I would suggest checking www.yourdomain.ext in google every 2 days as that is how long it takes for the cache to be recreated. Also bear in mind that you need to click the "search with ommited results included" bit at the very end of all the listings to get all the pages to appear.

[stevegpan2]

ncsuk,

The links have been there for a couple of weeks. In order to get indexed, I placed the link on index page.

But these linked do not show up on google, I did click "ommited results", not there either.

Could it be my index page pr4 too low?

(A couple of links from 2 months ago did show up though).

Thanks,

[takagi]

A PR4 is not too low for a site with some 30 pages. It takes some time for Google to generate a new index. Just wait for the next update if the links are only a few weeks old. Read more about the update in the Google Updates and Everflux, the Monthly Mid-Cycle Changes [webmasterworld.com] thread. The only thing that is changed since November is that the Google dance is no longer at the end of the month (last update was April 11).

[creative craig]

Also a read of this:

Googlebot: Deepbot and Freshbot FAQ and Information [webmasterworld.com]

Would help in understanding why your pages are in showing with a fresh date. :)

Craig

[stevegpan2]

takagi,

Thanks for the link. My understanding from the link is Google may freshcrawl some selected pages every few days. But only the monthly update is dependable and deep crawl.

So my options are:

1. put my new 26 linked pages to 26 web sites' index page so that they can be freshcrawl in a couple of days.
2. wait for next update to have the 26 linked pages, maybe in May or June.

Regards,

[creative craig]

You got it stevegpan2, put the links up now and they will be fresh crawled and also they should be included in the May/June update :)

Craig

[stevegpan2]

creative craig,

Thanks for your suggestion. So I will put these 26 pages to my 26 web sites' index page so that they can be picked up quickly (freshbot in a couple of days.) and also put the linked page on my main site's index page so deepcrawl can pick it upin 2 months for the long term purpose (and at that time, I will remove the liked page contents from my 26 web sites' index page)

That is great!

[stevegpan2]

I rechecked some of my other sites.

The PR does play a role for freshbot to come to visit. I have vists 4/29/2003.

It seems freshbot randomly picked some link path to refresh, as some of my linked pages refreshed and some are not, from pr3 to pr4.

[takagi]

A higher PR can help to get freshbot more often to visit your pages. But that was not your original question. As stated before, a visit by freshbot helps on the SERP only for a short time.

[stevegpan2]

Hi takagi,

Is there any rule what page freshbot likes to visit?
I have a cgi script like xyz.cgi?cat=1, 2, 3, 4

I found that freshbot visits some of the cat, but not others.

And freshbot likes to visit my xyz.cgi?cat=.. rather than my static html pages.

Hmmm. I am going to put my new 26 linked pages to xyz.cgi?cat=1, 2, ... 26 .

[takagi]

There are several factors that influence the freshbot:
1. PR of the page
2. new content on the page (for dynamic pages the last modified date can be important too)
3. being linked from a site that is often visited by freshbot
4. Age of the page (how long ago was it first added to Google's index)

and there will be more factors (how soon is the Google dance?).