Welcome to WebmasterWorld Guest from

Forum Moderators: DixonJones & mademetop

Message Too Old, No Replies

Time spent on a site by non-human

6:12 pm on Jun 8, 2010 (gmt 0)

Junior Member

5+ Year Member

joined:July 14, 2009
votes: 0

Approx. how much time spiders, worms etc. spend on a web site each visit? I assume- its a matter of few seconds, if not less...
Why I care about it? Because, in AWStats, one can find visit duration statistics.
Therefore, if non-human trafic only spend that much time each visit, it could be an indication of how much time HUMANS spend on the site.
4:05 pm on June 11, 2010 (gmt 0)

Administrator from US 

WebmasterWorld Administrator incredibill is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Jan 25, 2005
votes: 99

Depends, how big is your site?

I have 100K pages and a spider can spend hours poking around.

Some scapers/spiders only hit a page or two and run away, others try to take hundreds or thousands of pages at a time.

The only real conclusions you can draw that it's not human if it takes too many pages too quickly, downloads way more pages than a human can read, or stays on your site for a very long extended period of time.

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members