Forum Moderators: open
So if you are looking for a blue widget, for example, you enter "blue widget" into the search field and the blue widget appears in the results with a link that you can click on to go to a page that provides more detail and an add to shopping cart button.
There are no text links anywhere on the site to take the crawler directly to this dynamically generated "blue widget" page, it can only be found thru doing a search on "blue widget" or other related terms.
There are also no backward links from other sites to this page either. My question is, how would the Google spider find this page? It is dynamically generated and there are no backward links to it either internally or externally?
And if your answer is, the spider will not find it, then how is it that I can do a search on virtually any book title and see Amazon's dynamic page for that title ranking at or near the top of the SERP?
And how can I make sure the spider crawls these pages when the only way to find them is by doing a search? The only thing I can think of is a site map with text links to all 20,000 products!? Thanks for your help.
And if your answer is, the spider will not find it, then how is it that I can do a search on virtually any book title and see Amazon's dynamic page for that title ranking at or near the top of the SERP?
I'm sure this helps a bit [google.com].
Also, with Amazon, you do not have to search in order to get to specifc title pages. The have an extensive category/by author/related titles navigation system that allows bots to easily get to individual title pages.
Imagine going to wal-mart and when you get to the door you have to name the product exactly. They bring it to you, you put it in your cart. Then you tell them the next item.
You'd never settle for that--customers like to browse.