Msg#: 16381 posted 9:08 pm on Aug 22, 2003 (gmt 0)
I have a site with a home page PR of 6 and google seems to spider the nav bar consisting of 25 links but nothing else. I have 1000 or so internal page links from the homepage and google will completely ignore all of them. The bot comes by multiple times every day but only grabs the 25 links in the nav bar and ignores the 1000 or so links to internal pages from each of the 25 pages. I don't use java, dhtml, and all the pages on the website are with .html ext. I'm aware that google wants no more than 100 links on a given page but I've never had a problem like this before. Any thoughts?
Msg#: 16381 posted 10:30 pm on Aug 22, 2003 (gmt 0)
I'm in a similar situation. Google grabs the main front page links (product categories), a few of the subdirectory links (specific product categories) beneath those...but never beyond that to our actual product pages. PR is only at 2, and we've only been online now for about 3 months...but Google hits us 4-5 times/week and never goes further than explained.
Msg#: 16381 posted 11:50 pm on Aug 22, 2003 (gmt 0)
Yup just checked some of the new sites I put out there and lots of links are not getting spidered. Wonder if this means google is slowing down their continuious update or maybe they are moving back towards the dance... Oh well it was good while it lasted :/
Msg#: 16381 posted 2:01 am on Aug 23, 2003 (gmt 0)
just to let you know my sites have site maps.. I think google will do a deep crawl real soon, else their index might shrink which i don't think they want that to happen, they want to include every tidbit of information possible even if they don't rank it high i think they would rather have it than not, correct me if i'm wrong GoogleGuy if you're around.