Hi I just thought that I would let you guys know about a new Spider or web robot that we are now using.
The robot is called the " Linknzbot " and it is the web spider of the www.linknz.co.nz search engine.
It is presently being used to build a search engine that is New Zealand based, so I would doubt if your web site isn't based in New Zealand or contains content that is Kiwi based, then I would doubt that you may ever see it in your log files.
The robot obeys all robots.txt files and I would doubt it very much if it will ever start to eat at anyones bandwidth.
But since you guys & girls are mostly professional webmasters then it is only polite to let you know of what is crawling the web out there.
Any queries about the robot can be found using most search engines or if you visit our search engine site you can search for information about the robot.
I find it quite annoying when other robots start to dig into our server, we have two pages that can be spidered but we are still being visited at quite a high rate by other robots up to thirty times a day.
I have considered leaving a crawler file to say "Bugger off nothing to seen here!" for them to index.
But life goes on.
Happy new year to everyone and I must say that the www.webmasterworld web site is a brilliant source of information perhaps we should all try and support it more.
All the best
Dave Andrews
CEO Linknz Search
