Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

Whois.sc Probe/Bot

Prevent Snapshot Cache

3:41 am on Dec 2, 2003 (gmt 0)

New User

10+ Year Member

joined:Mar 29, 2003
votes: 0

Whois.sc is now taking an snapshot of each domain (index page only) and displaying the cache for any whois lookup.

Here is the robots.txt code for blocking their probe/bot:

User-agent: SurveyBot
Disallow: /