Forum Moderators: open

Message Too Old, No Replies

solfo-linkchecker

If it looks like a bot...

         

Pfui

3:11 am on Jul 3, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



gw-pub.la.solfo.net
solfo-linkchecker/1.0 (http://solfo.com/linkbot.html)

robots.txt? NO

Yes, it's a link-checker, but not the typical site link-checker deployed by an individual or a bloghost. Rather, Solfo's bot checks links in their own apparently commercial database(s). From the link in the UA:

Our system periodically checks the links we have on our yellow page directory sites to make sure they are working and accurate. The robot only does one GET request per website we have listed and doesn't "crawl". The robot has a user-agent string starting with "solfo-linkchecker".

Hmm.

I don't know who they are. I've never received referred traffic from them. Their bot only 'link-checked' a long-unused custom error URL -- kinda tough to call that a 'working link,' I'd say. So go 'way.

GaryK

6:57 pm on Jul 3, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



to make sure they are working and accurate

I wonder how they define accurate? Do they spider the page to see what's on it? Or just check to see if the page is still there? Either way I'm with you...if it smells like a bot...it must be a bot. A banned bot too!