Forum Moderated by: open

Crawler, Spider, and User Agent ID


Forum to identify search engine spiders and user agents

 
Thread SubjectMessagesStarted byLast Message
  Googlebot-Video/1.0"
audio & video files
5 keyplyr 11:25 pm May 11, 2015
  A new UA from Yahoo
YahooMobileHomerun
7 slipkid 2:54 am May 11, 2015
  Bingbot odd request
11 mrtonyg 2:24 am May 10, 2015
  Applebot
Fresh from Apple
18 Pfui 9:12 pm May 6, 2015
  Fortinet
8 slipkid 7:48 pm May 4, 2015
  github.com/typhoeus
29 aristotle 2:24 pm May 3, 2015
  Success in getting annoying someone/bot stopped
Hits coming from Cablevision IP
13 slipkid 5:24 pm Apr 20, 2015
  Facebook app?
4 lucy24 4:05 pm Apr 18, 2015
  CrazyWebCrawler
3 lucy24 1:32 am Apr 18, 2015
  cyren.com
8 keyplyr 3:15 am Apr 17, 2015
  =Mozilla/5.0
17 Pfui 8:55 am Apr 12, 2015
  InfoUSA/InfoGroup
2 keyplyr 9:19 pm Apr 10, 2015
  yoozBot
Iran
2 Pfui 11:00 am Apr 7, 2015
  IZSearch
10 keyplyr 3:51 pm Apr 5, 2015
  fossmovement
2 keyplyr 2:03 am Apr 4, 2015
  bingbot/3.0-alpha
11 Angonasec 8:18 am Mar 28, 2015
  TosCrawler
toshiba
15 keyplyr 1:58 am Mar 28, 2015
  alooflybot
aloofly.com
4 Pfui 9:12 pm Mar 27, 2015
  pt-PT
12 trintragula 8:33 pm Mar 24, 2015
  MSIE or Firefox mutant; not on Windows server
10 aristotle 8:02 pm Mar 22, 2015
  asp translation
12 lucy24 6:36 am Mar 20, 2015
  SheerBoredom Bot
3 Angonasec 3:47 am Mar 19, 2015
  BUbiNG
law-abiding Italian robot
6 lucy24 10:13 pm Mar 18, 2015
  Is this a bot?
13 aristotle 10:10 pm Mar 18, 2015
  Dataline
dtln.ru cloud servers
13 keyplyr 4:00 pm Mar 17, 2015