Welcome to WebmasterWorld Guest from 54.166.180.246

Forum Moderators: goodroi

Message Too Old, No Replies

Whois.sc Probe/Bot

Prevent Snapshot Cache

     
3:41 am on Dec 2, 2003 (gmt 0)

New User

10+ Year Member

joined:Mar 29, 2003
posts:33
votes: 0


Whois.sc is now taking an snapshot of each domain (index page only) and displaying the cache for any whois lookup.

Here is the robots.txt code for blocking their probe/bot:

User-agent: SurveyBot
Disallow: /

HTH.