Forum Moderators: open
Legitimate spiders usually have a recognizable UA. Google's spider is "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"
Nosy or homemade spiders often have no UA at all, or a phony one. Analyzing the UA is the first step to figuring out who your mysterious visitor was.