homepage Welcome to WebmasterWorld Guest from 54.196.195.158
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / WebmasterWorld / Website Analytics - Tracking and Logging
Forum Library, Charter, Moderators: Receptional & mademetop

Website Analytics - Tracking and Logging Forum

    
PeerFactor 404 crawler resurfacing?
Any idea who they are?
dataguy




msg:905031
 1:15 pm on Sep 27, 2005 (gmt 0)

Hit one of my sites 32,000 times last night. It was automatically blocked, but it sure is annoying.

Anyone have info on where it comes from?

 

hanuman




msg:905032
 12:32 am on Oct 4, 2005 (gmt 0)

whats the IP?
whats the UA?

help us to help you

dcrombie




msg:905033
 7:50 am on Oct 4, 2005 (gmt 0)

I've seen a couple of hits from them but nothing extreme:

ip address: 213.246.46.213 
method: HEAD
user agent: PeerFactor 404 crawler

Tracked them back to this website: [peerfactor.info...]

;)

keyplyr




msg:905034
 8:02 am on Oct 8, 2005 (gmt 0)

Tracked them back to this website: [peerfactor.info...]

Well that certainly clears things up ;)

GaryK




msg:905035
 3:06 pm on Nov 6, 2005 (gmt 0)

I had a visit from them yesterday. Took the same page hundreds of times before it was blocked.

User Agent:
PeerFactor Crawler

IP Address:
213.186.46.210

kevinpate




msg:905036
 3:22 pm on Nov 6, 2005 (gmt 0)

RewriteEngine On
RewriteCond %{REMOTE_ADDR} ^213\.
RewriteRule .* - [F]

note: this is absolutely a case of overkill and unadvisable IF there is other traffic traveling on the 213 expressway which interests you. However, if there isn't .... the above is an effective detour sign.

GaryK




msg:905037
 3:31 pm on Nov 6, 2005 (gmt 0)

Thanks Kevin but I use IIS. I achieve pretty much the same result using ISAPI_Rewrite. :)

DanA




msg:905038
 4:43 pm on Nov 6, 2005 (gmt 0)

The info about peerfactor is there, but in French :
[retspan.info...]
with a FAQ (Découvrez ici les réponses à toutes vos questions sur RetSpan!)
They pretend there that you may earn money by fighting against content piracy.
then there
[retspan.biz...]
I don't kwow what content they are analysing as the requests are HEAD only.

GaryK




msg:905039
 2:12 pm on Nov 13, 2005 (gmt 0)

Previously I'd only seen this crawler as Peer Factor. This past week I finally saw the user agent the rest of you mentioned, PeerFactor 404 crawler.

The new user agent did not read robots.txt and tried getting the same folder numerous times until it was banned.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / WebmasterWorld / Website Analytics - Tracking and Logging
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved