Can anyone give me an opinion on if you have a robots.txt do you also need a robots meta tag?
webjive81
6:47 pm on Sep 25, 2006 (gmt 0)
You can do one or the other or even both. It's usually easiest to just use the robots.txt file.
pazang
7:16 pm on Sep 25, 2006 (gmt 0)
Thanks for that
Is one better than the other?
goodroi
7:45 pm on Sep 27, 2006 (gmt 0)
using robots.txt would be my preference. by adding robots meta tags on every page you increase the file size of every page which is not a good thing. it is also simpler to manage the robots in one place by using robots.txt.