Forum Moderators: goodroi

Message Too Old, No Replies

Need Help With Robots.txt Question

         

BlueLeaf

2:45 am on Sep 19, 2006 (gmt 0)

10+ Year Member



I have a website hosted on a shared server, and I don't have the ability to access or edit the robots.txt [it's predefined by the hosting company]. My website is a family travel blog, and I don't want it indexed by any search engine. Can I place the robots.txt into the head tag or meta tags, or will the search engines ignore it?

leadegroot

2:55 am on Sep 19, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Yes, robots commands can also be issued as a meta string in the head of each webpage and ethical robots will obey it.
In fact, at least for Google, this is the only way to really be sure that a specific page is not in the results.
if you block in the robots.txt Google may still return your pages (with poor descriptions) if enough pages link to you.
If you block in the meta they will take the hint and refuse to index you.
i usually google for something like
robots protocol meta

when I am trying to get the exact syntax to use

james_plato

3:01 am on Sep 19, 2006 (gmt 0)

10+ Year Member



I would host your blog elsewhere if you don't want to be indexed. There are many free hosts that offer you the ability to have a private blog :)

BlueLeaf

4:23 am on Sep 19, 2006 (gmt 0)

10+ Year Member



Thanks for your help leadegroot.