Welcome to WebmasterWorld Guest from 54.146.180.94

Forum Moderators: goodroi

Exculde php url with vars using robots.txt

Exclude urls with vars using robots.txt

   
5:13 pm on Nov 3, 2005 (gmt 0)

10+ Year Member



Hello

I have a script that tracks downloads. The URL is in this format :

www.site.com/dl.php?var1=string&var2=string

What is the correct command to restrict bots from spidering that kind of file using robots.txt?
Will "Disallow: /dl.php" be enough?

Thank you

7:44 pm on Nov 3, 2005 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member



Yes, that should be enough.
 

Featured Threads

My Threads

Hot Threads This Week

Hot Threads This Month