Welcome to WebmasterWorld Guest from 220.127.116.11
Of course I ignored the email and added the bot to my disallow list, but my concern is that my site will be seen (by Google possibly) as participating in link farm tactics.
My name is Joel Lesser and I am the owner and CEO of Creative NetVentures, Inc, parent company of LinksManager.com.
I was notified that LinksManager and our LinkChecker bot was being discussed here in this forum so wanted to take a moment and reply to the concerns addressed here.
LinksManager.com is a patent pending application service that manages links pages for hundreds of websites that are powered by LinksManager. We are not a link farm or an automated service that pushes links to our customer's accounts. The majority of an account's links are submitted by webmasters requesting inclusion on a website's links pages powered by LinksManager.
LinksManager powers links pages for all sorts of sites such as http://www.1stforparties.com and http://www.localmusicdirectory.com and
large portals such as http://gamblinglinks.com.
When we designed LinksManager back in the late 90's, we incorporated a LinkChecker bot into the system so that when a link is added to a LinksManager powered website, the administrator of that account is notified when the link is being reciprocated. The only way to check for reciprocation is to run a link checker bot through the site looking for reciprocation.
The link checkers only browse text and does not download high bandwidth files such as graphics or rich media. The checkers are intentionally programmed not to put excessive load onto any one site. For more information about our bot: http://linksmanager.com/linkchecker.html.
It is true that the LinksManager link checker currently ignores robots.txt. We have struggled with this in the past.. if the checker ignores robots.txt, then reciprocation can be verified. If the link checker skips sites that have robots.txt, it's impossible for the LinksManager LinkChecker bot to do it's job effectively.
We are happy to add your domain to our ignore file upon request.
As robots.txt becomes more popular with webmasters, we are reanalyzing how reciprocation can be reported without having to spider the reciprocating site without the use of the LinkChecker bot. This takes time and an alternative solution will hopefully be forthcoming in the not too distant future. Comments such as yours on this forum help us realize how important this is to webmasters and I appreciate you discussing it here so we can be aware of your concerns.
(edited by: MarkHutch at 6:55 pm (utc) on Mar. 26, 2002)
Actually, it **would** be doing it's job most effectively. Otherwise, what's the use for robots.txt? That's what it's there for- to ban unwelcome web robots.
LinksManager does obey .htaccess though.
Mark asked "Can any member of your service request a site be crawled?" .. the answer is yes however we don't make it easy for a webmaster to import thousands of links and then request that they all be checked for reciprocation.
If your site is not swapping links with a LinksManager powered site, simply send your domain name(s) to firstname.lastname@example.org to be added to the ignore file.
If you have any other specific questions, let me know and I'll be happy to answer.
Following from your posts, I guess the next question is, can your site be slated for checking by one of your members even though you may not be aware they are linking to you?
And following up from that, assuming you see the linksmanager bot in your logs, which implies someone is linking to you, is it possible to request a list of the site/s linking to you to enable direct dialog before deciding on whether to ask to be ignored?
And finally, if this is a link tracking system, are the hits tracked through linksmanager as well and if so how do they appear in logs?
Again, thanks for helping out with useful info,