Can anyone give me any tips on how to tell the differance between a bot or if it's just a browser with a web accelerator?
What I'm seeing is a regular UA but it doesn't always get images. It starts out normal but ends with no images. It does this at a "human rate" and doesn't take very many pages. I see this from different IPs and they always go to different parts of the site, just like normal.
Another normal UA I see seems to be multi threaded in that it gets 2 pages in the same second. Sometimes the pages are the same page called twice and other times it calls default and the second page called is different, but at the same second.
Clear as mud I know.
Are these web accelerators? Or bots or browsers with the images disabled or am I just looking at log files too much?
vortech, most web accelerators (or similar tools), although perhaps NOT identified with an appropiate UA, will come from a reputable IP range of either a search engine utilizing some type or tool or a software that is exclusively for acceleration.