Forum Moderators: Robert Charlton & goodroi
I'm new here so I'm not sure if this topic its correct here... so move it please if needed.
I was working in a site with several pages (by far more than 300) all in a local server, close from outside...
When it was ready, it was uploaded to the web server and start the google indexation.
I saw somewhere that google penalizes with PR-0 if detects something strange like 300+ pages uploaded all together (this case)... ok.. we have PR-0 now.
But the problem is that not all the pages are indexed... in fact.. about only the 5% is indexed...
We checked with several seo tools and the site it's almost perfect in that point...
So... Is there a way to speedup the google indexation? we have internal and incoming links to almost all the pages, good keywords, changing content.. but somehow not all the pages are indexed...
How can I make my all pages get indexed quickly?
I now that we don't have a sitemap.xml. Is it really so important?
Unfortunately I can't reveal the name of the site that I'm working on... I know... this makes harder to get help.. but well... help me please...
I also saw that I have to put it in digg.com Will this help me?
Thanks a lot to all!
First, about the PR. Every site starts showing PR0 in the toolbar - and only when Google exports new PR data for the toolbar (about 4 times a year) do we get a snapshot look at changes. Nevertheless, on the back, Google is continually calculating and updating every page's REAL PR and using that number for ranking purposes. If indexed the pages that have links to you, you've got "some" PR, even though it may not be up to 1 yet, it's more than zero.
I saw somewhere that google penalizes with PR-0 if detects something strange like 300+ pages uploaded all together
This is not true. Guaranteed - I do it quite often.
How can I make my all pages get indexed quickly?
Google indexes at it's own speed. More links helps, good site structure helps -- but I almost never see any site with 100% of their URLs indeed, so this is not something you should expect, or think of as normal.
A friend of mine launched a decent, new site of about 118 pages. After three months, 112 urls are indexed. That's the way it often goes.
...we don't have a sitemap.xml. Is it really so important?
In my opinion, no - especially with 300 urls.
Unfortunately I can't reveal the name of the site that I'm working on.
That's OK, the Google Forum Charter [webmasterworld.com] doesn't allow members to mention the addresses of their own projects, anyway.
I also saw that I have to put it in digg.com Will this help me?
No, you don't have to digg your site. It can help some sites if people see an article, like it and then link to you. But digg is far from the only way to get links. We have an entire forum here discussing Link Development [webmasterworld.com]. You should be able to pick up a lot of ideas there.
How long has it been to see 5% of your pages indexed?
If it's only a week or two, that sounds about average to me. Then at some point in the near future, you could see a significant jump to maybe half or more. But maybe even another month or two to get into a more steady condition of closer to everything indexed.
...we don't have a sitemap.xml. Is it really so important?In my opinion, no - especially with 300 urls.
You can see that it's really a big site and there is a lot of development on it... and we released it all together. Thats why make any change will be a real pain, so I want to make sure that if a make a change will get a good result... you understand me.
How long has it been to see 5% of your pages indexed?If it's only a week or two, that sounds about average to me. Then at some point in the near future, you could see a significant jump to maybe half or more. But maybe even another month or two to get into a more steady condition of closer to everything indexed.
It have a couple of month now (from the first release), but we made a mistake with the pages header that maybe made the crawler "think" that are script pages. We have corrected it now (since 2-3 weeks now from the correction)
So I only have to wait or Can I do something to speedup or improve in the meanwhile?
Is there a must-have in all the sites to be correctly indexed?
I mean things like the robots.txt, Do you use it? Is it recommendable?
Do it have pros/cons?
Thank you so much for your help, tedster.
Finally:
I'm really sorry because I wasn't more specific from the beginning.
As you can see English isn't my mother language so if you read something a little aggressive, it was not my intention. :)
[edited by: WebFred at 6:55 pm (utc) on Sep. 17, 2007]
Nevertheless, on the back, Google is continually calculating and updating every page's REAL PR and using that number for ranking purposes.
Does Google really calculate PR continuously? I mean, if PR is as unimportant as people suggest, surely the resources involved in calculating it continuously could be better used?
Wouldn't it make more sense for them to perhaps guesstimate it for new pages (for example), then update the real PR, say once a month? On top of the normal day to day flux, would you notice any difference?
