Zeta Interactive?

Keep getting hit by bots from 64.40.121.nnn

[madmatt69]

Hey all,

I keep getting hit by bots from 64.40.121.nnn.

I did a whois and it comes up as "Zeta Interactive" - but there seem to be many companies with that name.

Has anyone else come across this bot?

[edited by: incrediBILL at 9:59 am (utc) on Sep. 18, 2009]
[edit reason] Obscured IPs [/edit]

[Pfui]

Details of the bot(s), please? User-agent string(s), whether or not robots.txt was requested/heeded, etc. Thanks!

[wilderness]

The entire backbone is a colo.

[madmatt69]

Heya,

User agent is SphereScout - I just tried banning it in my robots.txt, gonna check if its actually obeying.

I think it has something to do with that Sphere company that searches for updated blog posts.

Anyways, it keeps getting trapped in some of my links and bouncing around..Strange.

[wilderness]

I just tried banning it in my robots.txt, gonna check if its actually obeying.

Just for the sake of newbies that may read this thread?

Robots.txt does not "ban" or "deny" access to any robot, rather it makes a "request" to conforming bots to comply with your wishes.

[madmatt69]

Ya, what wilderness said :)

[incrediBILL]

Robots.txt only supplies directives for polite robots.

.htaccess bans impolite robots that ignore robots.txt