Forum Moderators: open
Java/1.6.0_37 86.163.57.28
Java/1.6.0_26
Java/1.6.0_04 64.124.140.174 (thefind?)
Java/1.7.0_09 67.221.35.135
TencentTraveler+4.0 (113.77.167.56)
xpymep.exe
Sogou+web+spider/4.0
Java/1.7.0_07 67.246.30.181
Motors/1.6.0+CFNetwork/609+Darwin/13.0.0
Microsoft+Windows+Network+Diagnostics 75.138.235.99
Willow+Internet+Crawler+by+Twotrees+V2.1
vBulletin+via+PHP
WWW-Mechanize/1.18 ( thefind 64.124.148.79)
Pixray-Seeker/2.0+(http://www.pixray.com/pixraybot;++crawler@pixray.com) 81.30.151.218
Google/2.0.1.10455+CFNetwork/548.0.4+Darwin/11.0.0
Feedfetcher-Google;+(+http://www.google.com/feedfetcher.html;+feed-id=992622134398468599)
-=*DriveDigitalGroup.com*=-+Dealerships+Websites+PPC+Inventory+Parts+Marketing
psbot/0.1+(+http://www.picsearch.com/bot.html)
Python-urllib/2.6
Yeti/1.0+(NHN+Corp.;+http://help.naver.com/robots/)
ee://aol/http
Google/2.0.0.10163+CFNetwork/485.13.9+Darwin/11.0.0
Microsoft+Office+Mobile+/14.0
sam-r390+UP.Browser/6.2.3.8+(GUI)+MMP/2.0 (50.57.206.198)
Mozilla/4.0
Feed::Find/0.07
Nessus (mcafee 161.69.30.158)
sam-r380+UP.Browser/6.2.3.8+(GUI)+MMP/2.0 174.141.208.104
linkdex.com/v2.0
Mozilla/3.0+(compatible;+NetPositive/2.2)
User-Agent:Mozilla/5.0+(SaidwotBot)
Mozilla/4.0+(compatible;+Synapse) 178.148.177.197
ImageHunter/2.4.0+CFNetwork/609+Darwin/13.0.0
OpenWebIndex/Nutch-1.5
Apache-HttpClient/UNAVAILABLE+(java+1.4) (tmobile getting an image)
oodlebot/1.0
HOT%20HD%20WPs/8.80.1+CFNetwork/609+Darwin/13.0.0 76.202.52.17
COMODOSpider/Nutch-1.2
Nutraspace/Nutch-1.2+(www.nutraspace.com)
Yahoo!+Slurp+China 110.75.173.196
Dalvik/1.4.0+(Linux;+U;+Android+2.3.5;+PC36100+Build/GRJ90)
Sogou+web+spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)
DTX
RedLaser/4.1.0+CFNetwork/609+Darwin/13.0.0
crawler4j+(http://code.google.com/p/crawler4j/) (not google 89.164.163.72)
AndroidDownloadManager
Mozilla/5.0+()
SuperPagesUrlVerifyBot/1.0
Aghaven/Nutch-1.2+(www.aghaven.com)
Java/1.6.0_20 (colo4 207.210.192.0/18)
Motors/1.5.3+CFNetwork/609+Darwin/13.0.0
YahooCacheSystem
Google/2.0.1.10455+CFNetwork/609+Darwin/13.0.0 (myvzw.com)
MyShopanion/1.5+CFNetwork/609+Darwin/13.0.0 (iphone app)
Google/2.5.1.13455+CFNetwork/548.0.3+Darwin/11.0.0
AF_ID=<26865> (amazonnaws 107.22.5.145)
Mozilla/4.0+(compatible;) (FYI there was about 500 requests all different files and IPs, ALL WERE MILITARY)
http://www.checkprivacy.or.kr:6600/RS/PRIVACY_ENFAQ.jsp
facebookexternalhit/1.1+(+http://www.facebook.com/externalhit_uatext.php) (fyi, facebook appears spidering)
facebookplatform/1.0+(+http://developers.facebook.com) [edited by: incrediBILL at 5:28 am (utc) on Nov 23, 2012]
[edit reason] disabled smilies [/edit]
BrowserMatch ^-?$ keep_out
BrowserMatch Ahrefs keep_out
BrowserMatch "America Online Browser" keep_out
BrowserMatch Clipish keep_out
BrowserMatch Covario keep_out
BrowserMatch CoverScout keep_out
BrowserMatch "Extreme Picture Finder" keep_out
BrowserMatch FairShare keep_out
BrowserMatch HTTrack keep_out
BrowserMatch "Jakarta Commons-HttpClient/3.1" keep_out
BrowserMatch "Java/" keep_out
BrowserMatch libcurl keep_out
BrowserMatch "MSIE [1-4]\." keep_out
BrowserMatch "Mozilla/[0-3]" keep_out
BrowserMatch NativeHost keep_out
BrowserMatch Python keep_out
BrowserMatch scanner keep_out
BrowserMatch TencentTraveler keep_out
BrowserMatch vcbot keep_out
BrowserMatch webcollage keep_out
BrowserMatch Wget keep_out
BrowserMatch Wikimpress keep_out
# comment-out following for link checker
BrowserMatch libwww-perl keep_out
BrowserMatch Yahoo keep_out