Welcome to WebmasterWorld Guest from 54.167.46.29

Forum Moderators: goodroi

Message Too Old, No Replies

Exculde php url with vars using robots.txt

Exclude urls with vars using robots.txt

     
5:13 pm on Nov 3, 2005 (gmt 0)

New User

10+ Year Member

joined:Mar 29, 2005
posts:19
votes: 0


Hello

I have a script that tracks downloads. The URL is in this format :

www.site.com/dl.php?var1=string&var2=string

What is the correct command to restrict bots from spidering that kind of file using robots.txt?
Will "Disallow: /dl.php" be enough?

Thank you

7:44 pm on Nov 3, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:May 31, 2005
posts:1108
votes: 0


Yes, that should be enough.
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members