Welcome to WebmasterWorld Guest from 54.226.194.180

Forum Moderators: goodroi

Message Too Old, No Replies

Potbot not respecting robots.txt

     

Scooter24

12:32 pm on Jan 24, 2003 (gmt 0)

10+ Year Member



Maybe somebody is interested in this:

I had a visit by Potbot 1.0 (IP: 216.40.238.201). It read the robots.txt file and then proceeded to browse through directories which were disallowed (automatically getting banned in the process).

korkus2000

1:09 pm on Jan 24, 2003 (gmt 0)

WebmasterWorld Senior Member korkus2000 is a WebmasterWorld Top Contributor of All Time 10+ Year Member



We had a discussion on potbot earlier.
[webmasterworld.com...]

little guy must be in full server abuse mode.

Scooter24

1:59 pm on Jan 24, 2003 (gmt 0)

10+ Year Member



I know, but so far nobody has reported abuses by potbot (which is why I made this post)
 

Featured Threads

Hot Threads This Week

Hot Threads This Month