incrediBILL - 7:11 pm on Nov 30, 2012 (gmt 0)
@qippo, Welcome to WebmasterWorld as we're definitely interested in the details of your crawler.
In addition, it is never appropriate to link to any website that you operate or that hosts your own content - no matter how authoritative that content may be.
Don, I think in this case, since they represent the crawler and are the authority, we would allow some links to pages that explain details about the crawler operation, IP range, etc. just like we allow for Google and Bing reps.
Basically, as long as the links are pertinent to the discussion and not promotional in nature I'll allow them.