Welcome to WebmasterWorld Guest from

Forum Moderators: bakedjake

Message Too Old, No Replies

Monitoring P2P Search Terms for Emerging Trends Data

Are there software programs that do this?

6:24 am on Mar 12, 2007 (gmt 0)

Junior Member

10+ Year Member

joined:Feb 6, 2007
votes: 0

I've noticed that P2P software programs like LimeWire are very popular with my demographic, and its user base are very quick to share new and emerging content.

LimeWire has an option to monitor incoming searches, but this is capped at the 99 latest.

I think these search terms can be extremely beneficial to me in monitoring new trends, and I would like to capture these words into a database in an automatic and scalable fashion.

Does anybody know if such as piece of software exists? It doesn't have to be exclusively for LimeWire, but for any P2P network.

An ideal program would have an option to record only search terms that contain a specified keyword, and would offer figures of how many times a given keyword was searched for.

1:56 pm on Mar 13, 2007 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:July 30, 2003
votes: 0

You should talk to SkyRider, a startup that's helping advertisers get in front of P2P search queries. They have technology that allows them to 'convince' the peers on P2P networks to rank search results (including their sponsored ads) the way SkyRider wants.

Sequoia (#2-3 VC here in Silicon Valley) invested in them, and the team are folks who in the past started Narus and worked on NSA wiretapping projects - they know their networking protocols. CEO is Ed Kozel who sits on Yahoo's board.

I imagine that if they wanted to they could tell you the top 100K queries on the P2P newtorks.


6:17 pm on Mar 15, 2007 (gmt 0)

Junior Member

10+ Year Member

joined:Nov 30, 2005
votes: 0

I did something like otem is talking about a few years ago. I downloaded an open source client for that network that ran on Linux (gnutella, I think). I turned up the bandwidth settings to pass lots of search messages. Then I redirected the search monitor to a text file. Easy. Megabytes of search data were soon on my drive. Then I used grep and other utilities to extract and count the occurences of terms I was interested in.

The new gnutella is gtk-gnutella - it has a graphic interface. I used the text-based client, as it had easier access to the underlying API.