Forum Moderators: open
But -Now they are back to spidering without identifying themselves. They have stated on their info page that their bot does not read robots.txt and that there is no way to opt out of being probed by them. So for those of us that would like to "opt out".
We see two different user agents for these visits. Sometimes, the bot shows us
user agent = "SurveyBot/2.2" followed by a cheap link to the site complete with anchor text (just in case your log files getlisted in GG). Other times the bot attempts to pretend to be a browser with this user agent:
"Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0)"
The referrer will be "http://www(link to the site in question).sc" or "http://www.virtual-private-server.com/"
This bot uses these ip addresses:
216.145.11.94
38.116.0.122
198.78.175.190
198.78.175.42
38.116.0.6
66.228.210.10
66.228.210.50
66.228.202.22
We reserve the right to refuse service to anyone - as it were.
What a great way to start a rumor and get the ban lifted by some people out of fear though.