Page is a not externally linkable
- WebmasterWorld
-- New To Web Development
---- How Do Search Engine Robots Work?


fishfinger - 12:17 pm on Jan 15, 2007 (gmt 0)


Robots (Googlebot included) definitely do action forms as I've seen pages indexed via the checkout and basket pages of shopping carts that use forms i.e.

basket.php?action=add

or similar.

I recommend blocking your basket, checkout, search etc pages in robots.txt as standard.


Thread source:: http://www.webmasterworld.com/new_web_development/3206921.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com