Forum Moderators: mack

Message Too Old, No Replies

Robots robot and robot

One identified by 'spider' the other 'robot'

         

User59

8:38 pm on Sep 8, 2005 (gmt 0)

10+ Year Member



Are Robots:

Unknown robot (identified by 'spider')

and

Unknown robot (identified by 'robot')

to put it bluntly, nice or nasty?

jatar_k

8:50 pm on Sep 8, 2005 (gmt 0)

WebmasterWorld Administrator 10+ Year Member



Welcome to WebmasterWorld User59,

The two different names (robot/spider) are interchangeable I don't believe that there is any predisposition towards good or evil based on it's naming.

User59

9:47 pm on Sep 8, 2005 (gmt 0)

10+ Year Member



Thanks, but one of my sites get copious visits from those two spiders. EasyAdmin stats says precisely:

Unknown robot (identified by 'spider')
7 66.89 KB06 Sep 2005 - 19:26

Alexa (IA Archiver)
3 33.42 KB07 Sep 2005 - 20:28

Inktomi Slurp
3 103.36 KB06 Sep 2005 - 02:37

Unknown robot (identified by 'robot')
2 98.62 KB05 Sep 2005 - 14:39

Lycos 1 19.72 KB02 Sep 2005 - 18:45

What are 'spider' and 'robot'? Are they good or bad?

jatar_k

10:05 pm on Sep 8, 2005 (gmt 0)

WebmasterWorld Administrator 10+ Year Member



ah, sorry, I see what you mean, I thought it was more a nomenclature question

what I do then is look through my raw server logs for the requests, find out the IP and then do an IP lookup to see where/who it resolves to. I then make my decision from there.

I normally assume that bots or spiders that do not announce who they are or where they are from as doing no good. I don't ban them outright until I see misbehaving, high load or the IP resolving to something I don't like.

User59

7:25 pm on Sep 9, 2005 (gmt 0)

10+ Year Member



Thanks, and a belated thank you for the welcome also.

I thought the raw logs are available, at least from one of the servers I use, presumably in _vti sub directory:
/web/_vti_bin/_vti_adm
/web/_vti_bin/_vti_aut
/web/_vti_cnf
/web/_vti_log
/web/_vti_pvt
/web/_vti_txt
but they are all empty, and
/username/mivadata is empty as well, accoridng to FTP anyway.

Where on earth are these raw logs, which must be needed for EasyAdmin to produce its - not useless - reports, and can you recommend begineer's software to interpret these logs?

webx.ehost-services.com - eNom - has a root directory called username, from which one can get higher, but see nothing except a directory folder, not even your own directory.

Inside one's username directory, there is only private, a couple of sample file folders and the files and folders I've uploaded.

Maybe eNom does even furnish raw logs?