Please help - what does the SE see?

[adammac]

I own a popular site, and like a lot of people, I use Inktomi submit to test my pages.

I have two types of URL - an optimized page that auto directs to another page, and the standard pages on my site.

With the click info, I can tell clearly that the optimized pages are the ones getting clicks, and my "regular" pages aren't getting too many.

I have tried some software that "tells" you what search engines really see, and when I ran it against my "normal" pages, it says that there are zero text on my pages body.

My pages are all dynamically generally, cached html pages... Does anyone know of any tool out there, or is there a simple way to understand what exactly a bot "sees"? It would be terrible if all they see are my navigation/categories.

Please help!

[fathom]

Developed by Brett

Search Engine Spider Simulator [searchengineworld.com]

[Robert Charlton]

My pages are all dynamically generally, cached html pages

Make sure you include links to the pages you want the engines to see. If you have a lot of pages, you'll have to figure out a good hierarchical internal linking structure. The structure of Open Directory is a good example of this... Note that main categories and most important subcategories are linked from the home page... and the rest are linked hierarchically from category and subcategory pages.