Forum Moderators: goodroi

Message Too Old, No Replies

Syntax help please

         

jcambert

3:10 pm on Mar 23, 2005 (gmt 0)



I have an OSCommerce/PHP site (rather large) and, alot of the content is duplicated, and, I'm trying to undo some of this damage. For example, is it possible to disallow robots from indexing/spidering

www.example.com/product_info.php/cPath/

and anything that comes AFTER that (and here comes the tricky part), WITHOUT disallowing them to spider:

www.example.com/product_info.php/products_id/1610

for example? In other words, ONLY when /product_info.php is followed by /cpath/ and anything after it, should it be disallowed. Is this possible?

Will

Disallow: /product_info.php/cpath

work?

JP

[edited by: ThomasB at 3:13 am (utc) on Mar. 29, 2005]
[edit reason] examplified [/edit]

ThomasB

3:14 am on Mar 29, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



JP, first of all, welcome to WebmasterWorld!

I'd suggest trying the following entry for your robots.txt:

Disallow: /product_info.php/cpath/