Forum Moderators: open
robots.txt? NO
That IP is server farm Vrtservers.net. Additional bad bots hailing from their Los Angeles and Sewickly, PA datacenters include:
64.56.64.nn - us_com_viewer larbin2.6.3@unspecified.mail
64.56.67.nn - #*$!_viewer (larbin2.6.3@unspecified.mail)
64.56.67.nn - cn_com_viewer larbin2.6.3@unspecified.mail
(last two are same IP)
74.222.3.nnn - com_viewer (larbin2.6.3@unspecified.mail)
74.222.3.nnn - google_three_web larbin2.6.3@unspecified.mail
74.222.3.nnn - pl_viewer larbin2.6.3@unspecified.mail
74.222.3.nnn - ru_viewer2 larbin2.6.3@unspecified.mail
74.222.3.nnn - tw_com_viewer larbin2.6.3@unspecified.mail
74.222.4.nnn - #*$!_viewer larbin2.6.3@unspecified.mail
(first six are same IP)
99% of the time, those bots asked for robots.txt, then ignored its blanket Disallow within seconds. E.g.:
15:07:32 /robots.txt
15:07:38 /subdir/filename.html