Welcome to WebmasterWorld Guest from 54.196.232.162

Forum Moderators: goodroi

Message Too Old, No Replies

robots.txt help

     
12:27 am on Nov 8, 2006 (gmt 0)

Junior Member

10+ Year Member

joined:Jan 18, 2005
posts:65
votes: 0


Below is my robots.txt file for my forum. I just noticed that the 2nd line does not specify anything after the colon, does it hurt to leave it the way it is?

User-agent: *
Disallow:
Disallow: /lofiversion/
Disallow: /cgi-bin/
Disallow: /style_images/
Disallow: /index.php?act=Search
Disallow: /index.php?act=Login

7:16 pm on Nov 8, 2006 (gmt 0)

Administrator from US 

WebmasterWorld Administrator goodroi is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:June 21, 2004
posts:3080
votes: 67


It is not the best way. I would remove that line.