Forum Moderators: goodroi

Message Too Old, No Replies

Stopping spiders

from Competitors Analysis Tools...

         

ambiorix_rb

5:18 am on Jun 1, 2005 (gmt 0)

10+ Year Member



Hi All,

My logs is showing that my site is being 'screened' by my competitor for any new changes I've made on the website.

(I can't show the site of the online chack tool due to TOS)

But is there any way I can block this kind of tracking with my robots.txt?

(Sorry for my bad English)

Ambiorix

peewhy

6:31 am on Jun 1, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I'm pretty sure robots don't take heed of the robots.txt. Perhaps you could ban the IP address?

Matt Probert

1:13 pm on Jun 1, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



In any event, your competitor will find another way of reviewing your changes. I shouldn't lose sleep over it.

Matt

oddsod

1:21 pm on Jun 1, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Feeding his IP with wrong info is probably better :)