Welcome to WebmasterWorld Guest from 54.147.250.33

Forum Moderators: DixonJones & mademetop

PeerFactor 404 crawler resurfacing?

Any idea who they are?

   
1:15 pm on Sep 27, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Hit one of my sites 32,000 times last night. It was automatically blocked, but it sure is annoying.

Anyone have info on where it comes from?

12:32 am on Oct 4, 2005 (gmt 0)

10+ Year Member



whats the IP?
whats the UA?

help us to help you

7:50 am on Oct 4, 2005 (gmt 0)

10+ Year Member



I've seen a couple of hits from them but nothing extreme:

ip address: 213.246.46.213 
method: HEAD
user agent: PeerFactor 404 crawler

Tracked them back to this website: [peerfactor.info...]

;)

8:02 am on Oct 8, 2005 (gmt 0)

WebmasterWorld Senior Member keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



Tracked them back to this website: [peerfactor.info...]

Well that certainly clears things up ;)

3:06 pm on Nov 6, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I had a visit from them yesterday. Took the same page hundreds of times before it was blocked.

User Agent:
PeerFactor Crawler

IP Address:
213.186.46.210

3:22 pm on Nov 6, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



RewriteEngine On
RewriteCond %{REMOTE_ADDR} ^213\.
RewriteRule .* - [F]

note: this is absolutely a case of overkill and unadvisable IF there is other traffic traveling on the 213 expressway which interests you. However, if there isn't .... the above is an effective detour sign.

3:31 pm on Nov 6, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Thanks Kevin but I use IIS. I achieve pretty much the same result using ISAPI_Rewrite. :)
4:43 pm on Nov 6, 2005 (gmt 0)

10+ Year Member



The info about peerfactor is there, but in French :
[retspan.info...]
with a FAQ (Découvrez ici les réponses à toutes vos questions sur RetSpan!)
They pretend there that you may earn money by fighting against content piracy.
then there
[retspan.biz...]
I don't kwow what content they are analysing as the requests are HEAD only.
2:12 pm on Nov 13, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Previously I'd only seen this crawler as Peer Factor. This past week I finally saw the user agent the rest of you mentioned, PeerFactor 404 crawler.

The new user agent did not read robots.txt and tried getting the same folder numerous times until it was banned.

 

Featured Threads

Hot Threads This Week

Hot Threads This Month