Welcome to WebmasterWorld Guest from 54.162.155.183

Forum Moderators: goodroi

Message Too Old, No Replies

Whois.sc Probe/Bot

Prevent Snapshot Cache

     
3:41 am on Dec 2, 2003 (gmt 0)

10+ Year Member



Whois.sc is now taking an snapshot of each domain (index page only) and displaying the cache for any whois lookup.

Here is the robots.txt code for blocking their probe/bot:

User-agent: SurveyBot
Disallow: /

HTH.

 

Featured Threads

Hot Threads This Week

Hot Threads This Month