Welcome to WebmasterWorld Guest from 126.96.36.199
Forum Moderators: goodroi
I have a script that tracks downloads. The URL is in this format :
What is the correct command to restrict bots from spidering that kind of file using robots.txt?
Will "Disallow: /dl.php" be enough?