Welcome to WebmasterWorld Guest from 54.226.146.15

Forum Moderators: goodroi

Message Too Old, No Replies

Whois.sc Probe/Bot

Prevent Snapshot Cache

     

CustomFit

3:41 am on Dec 2, 2003 (gmt 0)

10+ Year Member



Whois.sc is now taking an snapshot of each domain (index page only) and displaying the cache for any whois lookup.

Here is the robots.txt code for blocking their probe/bot:

User-agent: SurveyBot
Disallow: /

HTH.

 

Featured Threads

Hot Threads This Week

Hot Threads This Month