Welcome to WebmasterWorld Guest from 23.20.37.222

Forum Moderators: goodroi

Message Too Old, No Replies

robots.txt help

     
12:27 am on Nov 8, 2006 (gmt 0)

10+ Year Member



Below is my robots.txt file for my forum. I just noticed that the 2nd line does not specify anything after the colon, does it hurt to leave it the way it is?

User-agent: *
Disallow:
Disallow: /lofiversion/
Disallow: /cgi-bin/
Disallow: /style_images/
Disallow: /index.php?act=Search
Disallow: /index.php?act=Login

7:16 pm on Nov 8, 2006 (gmt 0)

WebmasterWorld Administrator goodroi is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



It is not the best way. I would remove that line.
 

Featured Threads

Hot Threads This Week

Hot Threads This Month