Welcome to WebmasterWorld Guest from 54.167.86.211

Forum Moderators: goodroi

Message Too Old, No Replies

Whois.sc Probe/Bot

Prevent Snapshot Cache

     
3:41 am on Dec 2, 2003 (gmt 0)

New User

10+ Year Member

joined:Mar 29, 2003
posts:33
votes: 0


Whois.sc is now taking an snapshot of each domain (index page only) and displaying the cache for any whois lookup.

Here is the robots.txt code for blocking their probe/bot:

User-agent: SurveyBot
Disallow: /

HTH.

 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members