Forum Moderators: open
Same here dude! But site is failrly new. Just 2 months old. So i suppose PR will get distrubuted in the next PR update. Also this site of mine has started showing on the SEPRS.
Webnewton, how many pages does your site has and has it bee fully crawled in these 2 months. I have a fairly new site (about 40 days old) with more than 500k pages of unique content, but Google has not crawled more than 1% of the site. The site has around 100 quality inbound links. I am banging my head against the wall and am completely baffled as to why Gbot doesn't deep crawl the site. First I though that there may be some sort of penalty on the domain (which I bought from a third party) but since i crawled several pages, my doubt ceased.
I have heard from many webmasters that Googlebot is very slow in indexeing new sites these days, but I haven't heard many discussing that topic here, so I am not sure whats going on..
Same thing with one of my sites. Was #1 for a very long time, and had PR6 sometimes 7. Now the homepage has PR5, all other pages have PR0 and they are NOT indexed. The complete domain has been removed from the index.
I don't understand that!
greg
it is a very old site (one of the very first serious e-commerce sites), and even the pages directly linked from the homepage have a PR 0.
It may be related to this: we have hundreds of "co-brands" for this site, and the urls for the co-branded sites are the exact same as those of the main site, except there is a cobrand code inserted right after the host name, i.e.:
URL for the home page of the site:
www.mysite.com
URL for a top-level category:
www.mysite.com/category1
URL for a cobranded site
www.mysite.com/cobrand
URL for the same top-level category in the co-branded site:
www.mysite.com/cobrand/category1
The pages for all the co-branded sites look 99% the same. They're all indexed. They're all pagerank 0 :(
Thanks a lot for the comments...
Yannick
BTW, the original post said he has all pages in the index so obviously it is not a link structure problem.
<added>
Although, I just checked one of them and it appears that it's back in the saddle, with internal pages showing (and transferring?) PR.
I hope both of you have site maps on your site. Try doing some link building for your site map and some other important pages. This will help.
Thanks webnewton for the suggestion. Sitemap is in place and around a 100 quality links from other sites also exists. Since I also manage many more sites, both small and pretty huge ones too, I am aware about the importance of a sitemap and inbound links :) I have noticed freshtags and deep crawl on all my other sites except this new one (around one month old). Googlebot does visit the site but is not doing any deepcrawl as I can understand from the logs.
My main question is: Are there more webmasters who have new sites, are well linked, and still not being hard hit by the googlebot?
I have noticed freshtags and deep crawl on all my other sites except this new one (around one month old).
I think you've answered your question youreself. Just be patient, your site will take some time before google start showing the cache for each and every page out there. Bot has read the whole of your site but will take some time to reflect the registered pages.
Why i suggested you to do link building for some specific page(other than home page) and the site map because this way Google will have to reflect them owing to the importance coming through linking pages.This is only required if you want to hasten up the process.
[edited by: webnewton at 8:08 am (utc) on May 20, 2004]
I also saw the same thing on my 30 month old main site when it was dropped from the rankings then subsequently reincluded. During the reinclusion process I believe that it behaved exactly as a new site would have done.
Googlebot looked only at the robots.txt and default page for two or three weeks then started to dig deeper. A week or two later my original PR5 came back on home page only. About a month further down the line this spread to the internal pages and within a further two or three weeks my site was back at the top of the rankings.
This whole process took more than two months.