Forum Moderated by: open

Crawler, Spider, and User Agent ID


Forum to identify search engine spiders and user agents

 
Thread SubjectMessagesStarted byLast Message
  Hit from "Blockchain Network Solutions"
Not sure what it's trying to accomplish
3 SumGuy 10:06 am June 4, 2019
  Hits from 104.132.0.0/16 (Google) - human or bot?
8 SumGuy 2:04 pm June 3, 2019
  Apache OpenOffice
10 lucy24 7:23 pm May 31, 2019
  FaceBook iPhone UA
2 wilderness 1:33 pm May 31, 2019
  OrgProbe/2.0.0
Checking to see if my site is up?
2 SumGuy 9:20 pm May 20, 2019
  Hits from Cisco Ironport
What is their purpose?
2 SumGuy 2:52 pm May 20, 2019
  Getting hammered by Bingbot
7 tangor 12:50 pm May 18, 2019
  Evergreen Googlebot Now Runs Latest Chromium Rendering Engine
6 engine 12:37 am May 15, 2019
  possible new bing crawl range
2 lucy24 1:54 am Apr 12, 2019
  Bots start looking for back.zip, backup.zip, etc.
Get rid of those if you have them in root.
3 SumGuy 12:32 pm Apr 10, 2019
  Google-speakr
6 phranque 9:23 pm Apr 5, 2019
  User Agent is Microsoft Office something or other
5 SumGuy 8:29 pm Apr 4, 2019
  Google 34
2 lucy24 1:48 am Apr 2, 2019
  Facebook cortex
8 lucy24 1:21 am Apr 2, 2019
  35.244.0.0/14 - Google or Merit (U-Mich) ?
4 SumGuy 6:23 pm Apr 1, 2019
  Getting lots of hits from this Cloudsigma. what's it?
3 born2run 5:58 am Mar 24, 2019
  Apple applebot increasing activity
Increasing hits to interior web pages
4 SumGuy 4:32 am Mar 18, 2019
  Google polyfill
8 lucy24 3:34 am Feb 25, 2019
  104.199.128.134
7 andrew_thom 2:19 am Feb 24, 2019
  Skotina via TOR
After so many years, scrapers are still there...
3 blend27 11:49 pm Feb 13, 2019
  URLTester
3 lucy24 6:07 am Feb 3, 2019
  Symantec from **.broadband.digiweb.ie
The range belongs to Symantec Corporation
7 blend27 10:09 pm Jan 28, 2019
  Microsoft and 13.64.0.0/11
Legit bing-bots? BingLocalSearch?
14 SumGuy 7:04 pm Jan 21, 2019
  Discordbot
3 keyplyr 2:40 am Jan 14, 2019
  iCab/5.8.4
2 TorontoBoy 1:03 am Jan 13, 2019