dblock - 1:44 pm on Jul 25, 2013 (gmt 0)
Starting around May 16th, 2013 I noticed a surge in Direct traffic on all of my sites. The pages that got this surge in traffic were just the topics pages (/topics/). I drilled down to see if I could get a country location but the main location that I see a huge increase in is (not set), so that wasn't helpful. I then took a look at the network properties and service providers and found one service provider that had a spike in visits - amazon.com inc. The browser which saw the highest increase was Internet Explorer, and the Operating System is Windows. There are two scenarios that I think could be possible:
1. Someone is scraping the content from the topic pages causing this influx of visits. The only thing that makes me doubt this, is that the engagement metrics (bounce rate, avg time on site, etc..) are not what a bot would usually show.
I'm currently analyzing the server log files, but not 100% sure of what I'm looking for. i've identified a couple of bots that are requesting hits for those specific pages (start with the directory /topics/). Can someone help with this situation?
All advice is welcome!