Welcome to WebmasterWorld Guest from 54.205.60.171

Forum Moderators: DixonJones & mademetop

Message Too Old, No Replies

PeerFactor 404 crawler resurfacing?

Any idea who they are?

     
1:15 pm on Sep 27, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Mar 12, 2004
posts:1355
votes: 0


Hit one of my sites 32,000 times last night. It was automatically blocked, but it sure is annoying.

Anyone have info on where it comes from?

12:32 am on Oct 4, 2005 (gmt 0)

Full Member

10+ Year Member

joined:June 10, 2002
posts:203
votes: 0


whats the IP?
whats the UA?

help us to help you

dcrombie

7:50 am on Oct 4, 2005 (gmt 0)

Inactive Member
Account Expired

 
 


I've seen a couple of hits from them but nothing extreme:

ip address: 213.246.46.213 
method: HEAD
user agent: PeerFactor 404 crawler

Tracked them back to this website: [peerfactor.info...]

;)

8:02 am on Oct 8, 2005 (gmt 0)

Moderator from US 

WebmasterWorld Administrator keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 26, 2001
posts:7740
votes: 262


Tracked them back to this website: [peerfactor.info...]

Well that certainly clears things up ;)

3:06 pm on Nov 6, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Sept 17, 2002
posts:2251
votes: 0


I had a visit from them yesterday. Took the same page hundreds of times before it was blocked.

User Agent:
PeerFactor Crawler

IP Address:
213.186.46.210

3:22 pm on Nov 6, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Dec 2, 2002
posts:1167
votes: 0


RewriteEngine On
RewriteCond %{REMOTE_ADDR} ^213\.
RewriteRule .* - [F]

note: this is absolutely a case of overkill and unadvisable IF there is other traffic traveling on the 213 expressway which interests you. However, if there isn't .... the above is an effective detour sign.

3:31 pm on Nov 6, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Sept 17, 2002
posts:2251
votes: 0


Thanks Kevin but I use IIS. I achieve pretty much the same result using ISAPI_Rewrite. :)
4:43 pm on Nov 6, 2005 (gmt 0)

Preferred Member

10+ Year Member

joined:Nov 29, 2003
posts:351
votes: 0


The info about peerfactor is there, but in French :
[retspan.info...]
with a FAQ (Découvrez ici les réponses à toutes vos questions sur RetSpan!)
They pretend there that you may earn money by fighting against content piracy.
then there
[retspan.biz...]
I don't kwow what content they are analysing as the requests are HEAD only.
2:12 pm on Nov 13, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Sept 17, 2002
posts:2251
votes: 0


Previously I'd only seen this crawler as Peer Factor. This past week I finally saw the user agent the rest of you mentioned, PeerFactor 404 crawler.

The new user agent did not read robots.txt and tried getting the same folder numerous times until it was banned.