Please tell me, where I can find list of web robots, user agents, crawlers and etc. With emails and urls of his owners.
I found [robotstxt.org...] may somebody know over good lists like that.
mack
2:24 pm on Jul 18, 2004 (gmt 0)
The source you provided is where the good guys register. It is quite a large collection. If you want to explore more options you could surf to Dmoz and Yahoo and go through the search engines categories to manualy seek out contact details.
