Forum Moderated by: open

Crawler, Spider, and User Agent ID


Forum to identify search engine spiders and user agents

 
Thread SubjectMessagesStarted byLast Message
  Anyone else seeing UA Mozilla 28.0
On Bell or HP IP (I think)
5 not2easy 1:08 pm July 18, 2014
  Anonymous Visits from Hosting Companies
18 aristotle 4:52 pm July 16, 2014
  Google Feedfetcher
14 aristotle 1:49 am July 16, 2014
  visionutils
4 lucy24 10:52 pm July 13, 2014
  bbbot/1.0.0
Well, that is new to me
2 blend27 6:51 pm July 13, 2014
  ?fb locale=
from Facebook[2] ( 1 2 )
32 Pfui 10:59 pm July 11, 2014
  srecorder dot com
3 lucy24 8:25 pm July 4, 2014
  katbot spider user agent and IP inforation
3 wilderness 7:10 pm June 30, 2014
  What's Crawling My Site?
15 incrediBILL 4:48 pm June 28, 2014
  Google's Site Verification Bot
A late warning
12 Angonasec 9:21 pm June 26, 2014
  Block non-North American Traffic for Dummies Like Me
Reducing the size of your blocking list.[4] ( 1 2 3 4 )
94 webcentric 6:38 pm June 26, 2014
  Did I accidentally block a real googlebot visit?
21 aristotle 11:59 am June 26, 2014
  Palo Alto Networks bot
10 slipkid 3:15 pm June 25, 2014
  memorybot
from: archivethe.net
4 Pfui 1:08 am June 22, 2014
  Map of the internet
some sort of weirdo search engine
4 slipkid 2:18 pm June 18, 2014
  bebopbot
3 lucy24 6:43 pm June 12, 2014
  Bot, Robot, Spider, Crawler from Brazil
6 lucy24 7:31 pm June 10, 2014
  Icap-iod
from Internap
6 keyplyr 5:05 pm June 10, 2014
  bare Mozilla from google range
2 lucy24 8:38 am June 6, 2014
  Naked Googlebot?
I am stumped with this Google IP hit
5 not2easy 5:46 pm May 31, 2014
  This. Is. Nasty.
14 lucy24 5:53 am May 31, 2014
  Puzzled by this UA behavior
5 aristotle 8:13 pm May 26, 2014
  Gimme60bot
4 lucy24 8:01 pm May 26, 2014
  How to Block Bogus User Agent ") )"
17 wilderness 7:18 pm May 24, 2014
  Zeek-heartbleed-notifyer user agent and IP data
3 keyplyr 6:53 pm May 22, 2014