Welcome to WebmasterWorld Guest from 54.226.25.231

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

Robot from Cisco Systems?

     

msgraph

2:21 pm on Jan 10, 2001 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Has anyone noticed this robot on any of their sites?

UA: CE
IP: 171.69.236.219

It's running off of Cisco Systems, Inc.

First it went for my robots.txt file, then my root page, then tried to access another domain within this site.

171.69.236.219 - - "GET / HTTP/1.0" 200 robots.txt HTTP/1.0" 302 214 "-" "CE"

171.69.236.219 - - "GET / HTTP/1.0" 200 "-" "CE" "-"

171.69.236.219 - - "GET / HTTP/1.0" 200 - "http://www.domain.com:80/" "CE" "-"

Cisco

3:21 pm on Jan 10, 2001 (gmt 0)

10+ Year Member



I have noticed this on and off for some time now. I have not been overly concerned because it hit random domains on a sporadic basis.

I run a robot alert cgi on my logs every half hour that looks for certain user agents as well as any hits to the robots.txt file. Then the script compares the ip against a know robot ip list. It will email me if anything is amiss. Today, 171.69.236.219 hit every domain I own (lots). Now I am concerned.

I can't find anything about this ip other than it is owned by Cisco Systems.

msgraph

3:30 pm on Jan 10, 2001 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Have the same type of thing set up on our systems. Works great for catching people trying to steal your pages or new search engine robots!

Since a large part of the net is running off Cisco equipment, I imagine they are just running server/connection integrity checks. If they are just doing small checks I'll leave them be, but if they get out of control they're going to get tossed in the banned user agent pile.

BoneHeadicus

5:36 pm on Jan 10, 2001 (gmt 0)

10+ Year Member



Cisco,
That sounds like something I might be interested in...is there a link to that script?

Cisco

5:54 pm on Jan 10, 2001 (gmt 0)

10+ Year Member



It's something that I wrote for my own use after missing an entire Google spidering blitz because I wasn't paying attention. Needless to say, it took me awhile to recover.

Sorry

BoneHeadicus

6:07 pm on Jan 10, 2001 (gmt 0)

10+ Year Member



You know whats really cool is I understand what has to take place in that type of situation..I just dont know how to code it out from scratch....I'm getting good at hacking stuff tho'.

Thanks anyway.

 

Featured Threads

Hot Threads This Week

Hot Threads This Month