Forum Moderators: goodroi

Message Too Old, No Replies

cloaking robots.txt

to avoid hacking

         

idolw

7:32 am on Oct 18, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



some recent threads mentioned hacking of robots.txt to remove a website from search engines like Google.

I am not an expert but had a following idea.
What if I cloaked my robots.txt in a way only SEs could see it and the user would be sent to the index page?

Do you think such solution could make things safer? What to look at if trying to use such solution?

DanA

8:05 am on Oct 18, 2006 (gmt 0)

10+ Year Member



Most of the time, users are not interested in robots.txt.
Only well behaved robots ask for this file.
Have a look there :
[google.com...]

idolw

9:42 am on Oct 18, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Most of the time, users are not interested in robots.txt.
Only well behaved robots ask for this file.

right. users are not interested unless they would like to do some harm.

DanA

12:26 pm on Oct 18, 2006 (gmt 0)

10+ Year Member



Did you have a look at the code here :
[webmasterworld.com...]
You don't need to examine robots.txt to do some harm unless you want to be spotted.