| Welcome to WebmasterWorld Guest from 220.127.116.11 |
register, login, search, subscribe, help, library, PubCon, announcements, recent posts, open posts,
|Subscribe and Support WebmasterWorld|
|Potbot not respecting robots.txt|
| 12:32 pm on Jan 24, 2003 (gmt 0)|
Maybe somebody is interested in this:
I had a visit by Potbot 1.0 (IP: 18.104.22.168). It read the robots.txt file and then proceeded to browse through directories which were disallowed (automatically getting banned in the process).
| 1:09 pm on Jan 24, 2003 (gmt 0)|
We had a discussion on potbot earlier.
little guy must be in full server abuse mode.
| 1:59 pm on Jan 24, 2003 (gmt 0)|
I know, but so far nobody has reported abuses by potbot (which is why I made this post)
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld ® and PubCon ® are a Registered Trademarks of Pubcon Inc.
© Pubcon Inc. 1996-2012 all rights reserved