Forum Moderators: DixonJones

Message Too Old, No Replies

SE crawler visits.

How do I weed these out of my stats?

         

Ash

3:41 pm on Sep 22, 2002 (gmt 0)

10+ Year Member



Hi, I'm trying to divide the spider visits from the rest of my stats. Is there a way of doing this short of collecting the never ending number of spider ip's? Thanks for any help.

Hannu

9:04 am on Sep 23, 2002 (gmt 0)

10+ Year Member



Normally you can filter out spider visits based on their agent names (i.e. browser).

So instead of filtering out all Googlebots ip addresses you just exclude "googlebot".

You can find a list of spiders here. [spiderhunter.com]

mosley700

9:12 am on Sep 23, 2002 (gmt 0)

10+ Year Member



AW stats can be configured to show Spiders as spiders. AW stats recognize up to 60 different spiders.