Forum Moderators: open

Message Too Old, No Replies

potbot 1.0

Unknown robot from everyone's internet

         

jdMorgan

10:10 pm on Jan 19, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Had a visit from this one - new to me.

It did fetch and obey robots.txt. It fetched up to four pages per second, and fetched only html documents - no JS, GIFs, or anything else.

A search turned up only log entries, and a mention of another program by the same name that allows multi-user game players to play against their computer using a robotic player (as I understand it).

Came in from Everyone's Internet - This and the fact I've never heard of it are the only suspicious things.

That's all I know about it - just a heads-up.

Jim


216.40.238.201 - - [19/Jan/2003:12:23:07 -0500] "GET /robots.txt HTTP/1.0" 200 2909 "-" "potbot 1.0"
216.40.238.201 - - [19/Jan/2003:12:23:07 -0500] "GET / HTTP/1.0" 200 30556 "-" "potbot 1.0"
216.40.238.201 - - [19/Jan/2003:12:23:08 -0500] "GET /ranger.html HTTP/1.0" 200 6870 "-" "potbot 1.0"
...
216.40.238.201 - - [19/Jan/2003:12:23:51 -0500] "GET / HTTP/1.0" 200 30556 "-" "potbot 1.0"

wilderness

11:27 pm on Jan 19, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Jim,
I recall this bot. Can't seem to find the reference in my NOT updated records.
I have portions of everyone denied although not 216.40.
I do recall using the SetEnvIf bot$ which condensed perhaps 4-5 entires then having been required to make some kind of change to accomodate google.

Sorry I can't provide more info. For a while a few at everyone were real pests.

wilderness

11:45 pm on Jan 19, 2003 (gmt 0)

jdMorgan

11:55 pm on Jan 19, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



wilderness,

Thanks! - Looks like another "generic" 'bot, then.

Jim

c3oc3o

11:03 pm on Jan 20, 2003 (gmt 0)

10+ Year Member



I doubt it's that one... that's a chat bot (for IRC networks).
While an IRC bot might be able to request web pages, there is no reason for it to get robots.txt, because it doesn't crawl.
Also, that app has not been updated since 2001.

Powdork

6:16 am on Jan 21, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I had my first visit from potbot. If he doesn't leave some nugs behind next time I will have to ban him;).
He did obey robots.txt but was grabbing up to five pages per second.

pendanticist

6:19 am on Jan 21, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Was it from the same IP Number as Jim posted?

Pendanticist.

WitchLars

10:11 pm on Jan 21, 2003 (gmt 0)

10+ Year Member



I received a visit from potbot as well. It came from 216.40.238.201, obeyed my robots.txt and fetched 4-5 pages a second.

-Lars

ukgimp

4:57 pm on Jan 23, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Gave my site a good kicking today. It doe not belive in spreading the load much. OK with dynamic URLs though.