Welcome to WebmasterWorld Guest from 126.96.36.199
Forum Moderators: open
Index page ranks top for one of its keywords an has PR 7 with dmoz entries. I see additional pages come and go - usually with a new date on the right - then gone in 24hrs.
There are two domains abc.com and abc.co.uk pointed to the same IP (history is great eh?...) Is this causing us a problem? One white bar orphan page. The bot hits us regularly but never indexes any links. All content is real with no attempt at manipulation other than following the layout rules.
New at this and stuck. What should I be thinking about? Should we move to all static pages? Are we barred? Why if it finds the links does it not index them If so how do I tell.
'preciate your thoughts
Welcome to WebmasterWorld!
How old is your site? If Google has only just found your site, your pages will pop in and out of
the index until you've been spidered for a complete month-long Google cycle. This is a normal
situation and nothing to worry about.
You should consider linking those orphans back to your home page.
Last month we brought 2 new sites online using the same software and layout. We have several links from PR8 pages to the new sites and when googlebot visited I thought they'd get a big deep crawl because of the PR8 links. BUT NO... They get the same crawl pattern as Site 'A'. IMO googlebot is much smarter than most think. My guess is that googlebot has some pretty advanced features to keep it from grabing dupe content and will avoid patterns that bring it to the same content even if it finds original content on the same path.
Right now we are building some site maps with just 1 variable links to our content. My guess is googlebot will eat these links up and I'll get most of our content back in. When the next crawl comes around I'll let everyone know how this experiment turns out.
My suggestion is give google your content through 1 path. Don't have diffent possible URL's to the same content or parts of the same content. This might happen through static pages or search results... Hope this helps...
Googlebot crawled over a 10 day period starting late last month until the 7th August and with hits of over 3,000 pages on some sites, we are expecting (and hoping) that things will return to normal.
Essentially one possibility is that this behaviour could be transient, check your linking structure (we had a lot of orphans) and make sure it is neatly laid out & the dynamic content is spiderable...I guess we'll find out and compare notes on the next update!
Please excuse daft question but can't see a definitive answer.