homepage Welcome to WebmasterWorld Guest from 54.204.142.143
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Subscribe to WebmasterWorld

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
Zeta Interactive?
Keep getting hit by bots from 64.40.121.nnn
madmatt69




msg:3991092
 6:09 pm on Sep 17, 2009 (gmt 0)

Hey all,

I keep getting hit by bots from 64.40.121.nnn.

I did a whois and it comes up as "Zeta Interactive" - but there seem to be many companies with that name.

Has anyone else come across this bot?

[edited by: incrediBILL at 9:59 am (utc) on Sep. 18, 2009]
[edit reason] Obscured IPs [/edit]

 

Pfui




msg:3991546
 12:47 pm on Sep 18, 2009 (gmt 0)

Details of the bot(s), please? User-agent string(s), whether or not robots.txt was requested/heeded, etc. Thanks!

wilderness




msg:3991564
 1:04 pm on Sep 18, 2009 (gmt 0)

The entire backbone is a colo.

madmatt69




msg:3991700
 3:44 pm on Sep 18, 2009 (gmt 0)

Heya,

User agent is SphereScout - I just tried banning it in my robots.txt, gonna check if its actually obeying.

I think it has something to do with that Sphere company that searches for updated blog posts.

Anyways, it keeps getting trapped in some of my links and bouncing around..Strange.

wilderness




msg:3991735
 4:28 pm on Sep 18, 2009 (gmt 0)

I just tried banning it in my robots.txt, gonna check if its actually obeying.

Just for the sake of newbies that may read this thread?

Robots.txt does not "ban" or "deny" access to any robot, rather it makes a "request" to conforming bots to comply with your wishes.

madmatt69




msg:3991737
 4:33 pm on Sep 18, 2009 (gmt 0)

Ya, what wilderness said :)

incrediBILL




msg:3991785
 5:53 pm on Sep 18, 2009 (gmt 0)

Robots.txt only supplies directives for polite robots.

.htaccess bans impolite robots that ignore robots.txt

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved