Forum Moderated by: open

Crawler, Spider, and User Agent ID


Forum to identify search engine spiders and user agents

 
Thread SubjectMessagesStarted byLast Message
  integrity/3.0
2 keyplyr 6:31 am Oct 13, 2009
  Please welcome Ocean10000 as new Spiders co-Moderator
13 incrediBILL 5:03 pm Oct 9, 2009
  MSR-ISRCCrawler repurposed
Now with analysis "for Microsoft's Search and Ads services"
7 caribguy 12:16 am Oct 9, 2009
  msnbot/.search.msn.com uses Wget
5 Pfui 7:21 pm Oct 7, 2009
  Yahoo!-AdCrawler
5 GaryK 6:16 pm Oct 7, 2009
  Internetbot
3 GaryK 3:32 am Oct 7, 2009
  Qseero v1.0.0
6 keyplyr 12:10 am Oct 7, 2009
  What really is doing PC Media Center ?
5 schnee 1:29 pm Oct 6, 2009
  TencentTraveler
6 GaryK 1:34 am Oct 6, 2009
  S2Bot/1.0
5 keyplyr 12:46 am Oct 6, 2009
  parchmenthill
13 Pfui 12:34 am Oct 6, 2009
  Will the Real Googlebot-Mobile Please setup forward.
Googlebot-Mobile
3 Ocean10000 10:24 pm Oct 4, 2009
  LinkExaminer/1.01 (Windows)
2 GaryK 10:07 pm Oct 4, 2009
  Yahoo! SearchMonkey
3 wilderness 10:03 pm Oct 4, 2009
  taptubot
9 Pfui 5:19 pm Oct 4, 2009
  Micro trend is goofing my system
Micro trend is goofing my system
14 schnee 5:28 pm Oct 3, 2009
  Outlook 2007 RSS User-Agent
2 Ocean10000 6:05 am Oct 1, 2009
  Dot TK - spider
4 keyplyr 5:31 am Sept 30, 2009
  FlickySearchBot/1.0
3 keyplyr 9:23 am Sept 25, 2009
  IP Banning Primer
29 httpwebwitch 10:37 pm Sept 23, 2009
  YahooCacheSystem
6 Pfui 12:23 am Sept 23, 2009
  LargeSmall Crawler
3 Pfui 12:20 am Sept 23, 2009
  Yahoo
16 wilderness 7:11 pm Sept 21, 2009
  Domain Tools Now Using GurujiBot
IP is from Name Intelligence
4 incrediBILL 7:27 pm Sept 20, 2009
  MSN's cloak-crawling again: Twitter / Tweets
Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0)
3 Pfui 6:32 pm Sept 20, 2009