homepage Welcome to WebmasterWorld Guest from 54.161.214.221
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / WebmasterWorld / Webmaster General
Forum Library, Charter, Moderators: phranque

Webmaster General Forum

    
From the "Well Duh" file
Robots inflate traffic figures
Brett_Tabke




msg:389201
 2:19 pm on Sep 20, 2001 (gmt 0)

Web Server Logs, Unable to Distinguish Human Activity From Robots and Spiders, Are Providing Inaccurate Data for Web Operators, Advertisers

They put a media advisory press release for that?

[biz.yahoo.com...]

 

rcjordan




msg:389202
 2:37 pm on Sep 20, 2001 (gmt 0)

Here's what they're hyping
Most robots harvest only textual content and do not download images or execute JavaScript code. By using JavaScript and an image request, HitBox Enterprise filters robots with a very high success rate.

Thanks for the article, I've been asked to provide evidence to refute the traffic claims of a consultant/developer that's running a web project for a state agency (a massive pork barrel). I'll add this to the file.

littleman




msg:389203
 4:12 pm on Sep 20, 2001 (gmt 0)

What do your all think the bot/human ratio is over all in the net? Off the top, I'd say 50/50.

rcjordan




msg:389204
 4:31 pm on Sep 20, 2001 (gmt 0)

I was thinking 30/70 overall (now that toolman has quit playing with his link spider). Too low?

(edited by: rcjordan at 4:32 pm (gmt) on Sep. 20, 2001)

WebGuerrilla




msg:389205
 4:31 pm on Sep 20, 2001 (gmt 0)

I think the ratio is directly connected to your PageRank. :) 50% probablly is a good average, but I see sites fairly often with bot activity much higher than that.

What's even more bizzare is how often a particular company counts bot traffic that they created as human visitors. Someone in the IT department signs up for one of those annoying monitoring services that randomly hit your site every 10 minutes. A week later, someone in the marketing department logs into the WebTrends report and sees the increase in traffic. The next thing you know, he/she is firing off emails (with every important executive listed in the CC: ) announcing the great success the marketing department has achieved.

I have even run into situations where the agency a company was using intentionally created a monitoring account and then reported it to the client as traffic.

rcjordan




msg:389206
 4:37 pm on Sep 20, 2001 (gmt 0)

>he/she is firing off emails (with every important executive listed in the CC: ) announcing the great success the marketing department has achieved.

See my comment above about the pork barrel project. Man, the b-s I'm digging through. In this case, one of the commissioners happened to know just enough to smell something was rotten.

Brett_Tabke




msg:389207
 4:56 pm on Sep 20, 2001 (gmt 0)

It's why to me, the only statistics that matter are Uniques, Views per Unique, and Referrals.

Macguru




msg:389208
 5:00 pm on Sep 20, 2001 (gmt 0)

>I was thinking 30/70 overall

What I got 2 days ago was 99% from infected servers! :)

The spider/human ratio depends directly on the demand of keyword the site uses. Niche markets sites are easy to position and will generally get more spider traffic than anything else. If your client in some competitive market spends enough to get good positions, spider traffic, yet welcomed, will be under 5%.

Since the best SE's found just a portion of pages trown at the Internet sea, it is difficult to put any global numbers. It also depends on wich SE spiders your site. marvin from NL crawls the whole shabang every week and gets me .001 visitor a year. :)

One thing is for sure, too much Web sites get no visits from spiders and a few visits by the owners.

rcjordan




msg:389209
 5:06 pm on Sep 20, 2001 (gmt 0)

>the only statistics that matter are Uniques, Views per Unique, and Referrals.

I'm really nailing the group I'm helping to audit... The site has an information request form, I'm asking for the mailing list it has generated, names/address/zipcode. I'll then suggest that this be verified by cross-matching to the postage expense roster from their general ledger.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / WebmasterWorld / Webmaster General
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved