googlebots crawl

controlling where goglebot crawls

[clickthinker]

Hi there

Is there a way to ensure that googlebot crawls specific links to internal pages?

I've had a look at the log files from the weekend for one of our sites.
I've always thought that google bot does not follow image links.
We have several product categories and each category has a landing page.
Each of the products are display on this page with text links pointing to the product details page, a bit of blurb on the product and "enquire about product" button that is a .gif that links through to a "Contact Us" form.
Googlebot is following all of the buttons through to the contact form and doesn't seem to be crawling the text links to the product pages.

I've excluded the "Contact Us" folder in the robot.txt file, but is ther any more I can try to get googlebot to crawl all of the product pages?

thanks

[bufferzone]

By designing your internal link structure you can go some way in ensuring that your pages are being crawled. By using robots.txt you can control what pages are not crawled.

As a general guideline you should know that a page with only one link pointing to it is not considered important. A page with many links pointing to it is more important and will often be crawled more efficiently