Forum Moderators: open

Message Too Old, No Replies

Larbin

Starting to see more of them...

         

netcommr

3:05 am on Dec 7, 2001 (gmt 0)

10+ Year Member



I am starting to see many Larbin [pauillac.inria.fr] crawlers.

Does anyone see this as a 'pain in the site', or do you just ignore them.

Son_House

3:29 am on Dec 7, 2001 (gmt 0)

10+ Year Member



I have been seeing them as well. So far I have just been ignoring them and letting them do their thing.

wilderness

11:58 pm on Dec 8, 2001 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Personally I don't think Larbin or any other bot is to be ignored :-(
Their purpose, intent and whether they wander from their own defined procedures should determine whether you allowed their continued access of your site.

The following portion from a Larbin page:
"The goal of Larbin was to go and fetch xml pages"
end of quote

Do you desire others placing links within the presentation of your pages without your knowledge or approval?

I omitted Larbin from access some time ago.