homepage Welcome to WebmasterWorld Guest from 54.226.173.169
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
BoardReader-Image-Fetcher
wilderness




msg:3364583
 6:21 pm on Jun 11, 2007 (gmt 0)

208.65.71.66 - - [10/Jun/2007:12:15:30 -0500] "GET /robots.txt HTTP/1.1" 403 - "-" "User-Agent: BoardReader-Image-Fetcher /1.0 info@boardreader.com"

Began a few days ago with an image link submitted to a board in January.
It likley would not be so alarming, however the images the bot is attemtpting to crawl were placed in TMP folders and are customarily removed within a week of providing the link.

Someinteresting reading on the company:
[google.com...]

[edited by: volatilegx at 3:05 am (utc) on June 19, 2007]
[edit reason] fixed broken link [/edit]

 

fiestagirl




msg:3370353
 7:14 pm on Jun 17, 2007 (gmt 0)

I always find it interesting to read about how a company is selling "Business Intelligence" by using my content. thanks.

I've seen this UA also: (381896) User-Agent: BoardReader Favicon Fetcher /1.0 info@boardreader.com

keyplyr




msg:3377730
 3:17 am on Jun 25, 2007 (gmt 0)

I block "User-Agent:"

Never seen a legit use.

wilderness




msg:3377810
 5:15 am on Jun 25, 2007 (gmt 0)

Great UA they have.

Caught three of mine ;)

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved