Exalead -- it comes for your .mov files

Why should I let this sucker on my system?

[berli]

So, this parasitical bot called "Exalead" came to my site and after getting 403'd once by the hotlinking protection it managed to download the mov file I have hosted there. I went to the exalead website (name + .com) and I found out it's a "multimedia search engine" with a contract with AOL France.

Now, if you want to find multimedia online that's all well and good, but why would they have to download my mov file to do that? Seems a bit fishy to me.

Any thoughts?

[berli]

Whoops!

Posted too soon, didn't check it over carefully. Exalead only grabbed my header data, not the entire .mov file. Phew! I don't give a dried fig if it wants to grab some headers so, hey, I'm cool.

[jdMorgan]

Looking for info on Exalead, I found this thread...

Does anyone know what User-agent string Exalead expects in robots.txt? Not sure if it should be "Exalead", "Exalead NG", or just "NG". I could not find a robots.txt info page on their site.

Thanks,
Jim

[guillermo5000]

I don't know what User-agent it expects, but it visited my site with the UA of "ng1.exabot.com" and it did request robots.txt