Forum Moderators: mack
Unknown robot (identified by 'spider')
7 66.89 KB06 Sep 2005 - 19:26
Alexa (IA Archiver)
3 33.42 KB07 Sep 2005 - 20:28
Inktomi Slurp
3 103.36 KB06 Sep 2005 - 02:37
Unknown robot (identified by 'robot')
2 98.62 KB05 Sep 2005 - 14:39
Lycos 1 19.72 KB02 Sep 2005 - 18:45
What are 'spider' and 'robot'? Are they good or bad?
what I do then is look through my raw server logs for the requests, find out the IP and then do an IP lookup to see where/who it resolves to. I then make my decision from there.
I normally assume that bots or spiders that do not announce who they are or where they are from as doing no good. I don't ban them outright until I see misbehaving, high load or the IP resolving to something I don't like.
I thought the raw logs are available, at least from one of the servers I use, presumably in _vti sub directory:
/web/_vti_bin/_vti_adm
/web/_vti_bin/_vti_aut
/web/_vti_cnf
/web/_vti_log
/web/_vti_pvt
/web/_vti_txt
but they are all empty, and
/username/mivadata is empty as well, accoridng to FTP anyway.
Where on earth are these raw logs, which must be needed for EasyAdmin to produce its - not useless - reports, and can you recommend begineer's software to interpret these logs?
webx.ehost-services.com - eNom - has a root directory called username, from which one can get higher, but see nothing except a directory folder, not even your own directory.
Inside one's username directory, there is only private, a couple of sample file folders and the files and folders I've uploaded.
Maybe eNom does even furnish raw logs?