JobSpider

No jobs here!

[bobothecat]

Certainly can't accuse it of not reading robots.txt, in fact that's all it did. Not too thrilled on how it changes user agents, and the fact that there's no job listings on my site - banned. IP takes you to a password login, with some reference to "finbot".

213.61.218.22 - - [11/Jul/2005:20:13:49 -0600] "GET /robots.txt HTTP/1.1" 200 4612 "-" "JobSpider_BA/1.1"
213.61.218.22 - - [11/Jul/2005:20:13:50 -0600] "GET /robots.txt HTTP/1.0" 200 4612 "-" "JobSpider/1.6.2 (PHP; MySql)"
213.61.218.22 - - [11/Jul/2005:20:13:50 -0600] "GET /robots.txt HTTP/1.1" 200 4612 "-" "JobSpider_BA/1.1"
213.61.218.22 - - [11/Jul/2005:20:13:51 -0600] "GET /robots.txt HTTP/1.0" 200 4612 "-" "JobSpider/1.6.2 (PHP; MySql)"

[GaryK]

One possibility:

The IP Address you referenced belongs to finbot.com. That website has a product called JobRoboter which looks for jobs.

[finbot.com...]

[bobothecat]

One possibility:
The IP Address you referenced belongs to finbot.com. That website has a product called JobRoboter which looks for jobs.

Sounds like a good possibility to me :)

Went ahead and banned anyway... the website it visited never has offered information on jobs, asked for employment, or anything in regards to the subject. Seems it may just be a 'blind' spider, but no need to eat bandwidth, or my files :)