compatible;+Indy+Library

Forum Moderators: open

Message Too Old, No Replies

compatible;+Indy+Library

211.101.236.93

dolphin

5:39 pm on Oct 3, 2001 (gmt 0)

Anyone seeing this one crawling? I have been seeing this 211.101.236.93 crawling through the whole site. It doesn't look for robots.txt file, but crawls whole site. I can't pinpoint who it is, other than from asia. Anyone know? In the user agent it says (compatible;+Indy+Library)
I wonder if it might be a competitive bot looking to copy pages that are getting high rankings? Anyone know what the indy+library is?

Marcia

6:11 pm on Oct 3, 2001 (gmt 0)

dolphin, there were a couple of threads on Indy Library a while back you'll find helpful:

[webmasterworld.com...]

bird

11:33 pm on Oct 4, 2001 (gmt 0)

Just to confirm that it is indeed an e-mail harvester. I just got some spam with this header:

X-Library: Indy 8.009B

It came from china as suggested before, but was surprisingly well targeted, which is one reason why I even bothered to look into the headers...