Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- above the law? ignores ROBOTS.TXT
keyplyr - 3:09 pm on May 13, 2013 (gmt 0)Thread source:: http://www.webmasterworld.com/search_engine_spiders/4573203.htm
The offending robot belongs to verisign. But wait! Aren't they supposed to be the good guys?
What ever made you think that? Their unethical antics and breaches of privacy are legendary.
Brought to you by WebmasterWorld: http://www.webmasterworld.com