Forum Moderators: open

Message Too Old, No Replies

[OWR_Crawler] New bot?

         

Orange_XL

10:27 am on Jan 20, 2003 (gmt 0)

10+ Year Member



198.169.127.98 - - [20/Jan/2003:08:55:35 +0100] "GET / HTTP/1.0" 200 9944 "-" "OWR_Crawler 0.1"

IP seems related to www.innovationplace.com, a canadian business and university research project.
Anyone got more info?

wilderness

10:50 pm on Jan 20, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



198.169.127.97 - - [15/Jan/2003:17:39:38 -0800] "GET /robots.txt HTTP/1.0" 200 2058 "-" "ASPseek/1.2.10"

Different UA than your visitor
Innovation Place

I viewed the innovation page and didn't care for the very broad "research" explanation.
As a result I denied 198.169.125-127

jdMorgan

10:32 pm on Jan 21, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



It showed up here, too.

198.169.127.98 - - [21/Jan/2003:15:10:29 -0500] "GET /robots.txt HTTP/1.0" 200 2919 "-" "OWR_Crawler 0.1"

Jim

wilderness

3:25 am on Jan 22, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Seems it returned a mere six days later with a new UA :-)
198.169.127.98 - - [21/Jan/2003:16:16:43 -0800] "GET /robots.txt HTTP/1.0" 403 - "-" "OWR_Crawler 0.1"

jdMorgan

3:31 am on Jan 22, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



wilderness,

I don't care about either of these UAs, so I stuck a Disallow for each of them into my robot.txt. If either one comes back, I'll post on whether they obey it. If not, I'll return the same server response you do... :)

The fact that they're changing UA's does not look good, but I figure I'll go ahead and collect the data.

Jim

wilderness

4:08 am on Jan 22, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Jim,
Perhaps their research is just gathering momentem :-)
Don

wilderness

11:08 pm on Jan 29, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Just a follow up on this.
As I looked at the Whois on innovation I recalled seeing those numbers some place previously.

For some time I was getting some sparodic and unidentified crawling from Videotron.
Which happens to be the backbone for innovation.
And now the pieces of the puzzle fit ;)