| Welcome to WebmasterWorld Guest from 220.127.116.11 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Pubcon Platinum Sponsor 2014|
|Potbot not respecting robots.txt|
| 12:32 pm on Jan 24, 2003 (gmt 0)|
Maybe somebody is interested in this:
I had a visit by Potbot 1.0 (IP: 18.104.22.168). It read the robots.txt file and then proceeded to browse through directories which were disallowed (automatically getting banned in the process).
| 1:09 pm on Jan 24, 2003 (gmt 0)|
We had a discussion on potbot earlier.
little guy must be in full server abuse mode.
| 1:59 pm on Jan 24, 2003 (gmt 0)|
I know, but so far nobody has reported abuses by potbot (which is why I made this post)
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved