Forum Moderators: open

Message Too Old, No Replies

is this an actual spider from inktomi?

it's hit my honey pot and in-order to do that it has to have inteligence

         

anoryu

3:06 pm on Apr 29, 2003 (gmt 0)

10+ Year Member



1) REMOTE_ADDR: 66.196.72.48
2) HTTP_USER_AGENT: Mozilla/5.0 (Slurp/cat; slurp@inktomi.com; [inktomi.com...]
3) DATE STAMP: 20030428192400

jdMorgan

3:11 pm on Apr 29, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



That's a valid Ink IP address, and the User-agent looks valid.

...Maybe not enough intelligence!

Make sure your robots.txt is validated [searchengineworld.com] and Disallows access to your honeypot - That's the only reason I can think of that they'd fetch it.

Jim

anoryu

2:08 pm on Apr 30, 2003 (gmt 0)

10+ Year Member



thanks for the Info I will look into it... I know we have an htaccess file that takes care of a lot... I'm not sure if we have set up a robot.txt file more to come