Forum Moderators: open

Message Too Old, No Replies

openfind wont go away....

         

Dpeper

8:08 pm on Jul 18, 2002 (gmt 0)

10+ Year Member



What is openfind when i go to it its some asian web site (chinese, japanese) And it wont stop spidering my page its been there for the last week going through the whole site every day then starting over the next. Im considering blocking it but i want to make sure its not important first.

Openfind data gatherer, Openbot/3.0+(robot-response@openfind.com.tw;+http://www.openfind.com.tw/robo

Dpeper

9:22 pm on Jul 18, 2002 (gmt 0)

10+ Year Member



any one have a clue what it is?

korkus2000

10:41 pm on Jul 18, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I have had it bombard my servers for 4 months. I have never had a referal. I am banning it.

RBuzz

10:52 pm on Jul 18, 2002 (gmt 0)

10+ Year Member



It's a new search engine. The English interface is at [openfind.com...] . They say they're in beta but I think it's more like late alpha (I couldn't find a privacy or help file, several of my searches timed out, etc.) There's a contact address at [openfind.com...] .

jdMorgan

10:56 pm on Jul 18, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Dpeper,

It's a Chinese (Taiwan, Nationalist Republic of China, i.e non-communist) search engine.

They have an English information page if you follow the URL in your logs.

Depending on whether you might do business with Taiwan, it might be important and it might not.

You might try disallowing it in robots.txt if you don't want it to spider your site.

It has been well-behaved on my site, and I prefer Taipei's gov to Beijing's...

Jim

korkus2000

11:05 pm on Jul 18, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



It has not respected my robots.txt.