homepage Welcome to WebmasterWorld Guest from 54.161.247.22
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Alternative Search Engines
Forum Library, Charter, Moderators: bakedjake

Alternative Search Engines Forum

    
Monitoring P2P Search Terms for Emerging Trends Data
Are there software programs that do this?
otem




msg:3279044
 6:24 am on Mar 12, 2007 (gmt 0)

I've noticed that P2P software programs like LimeWire are very popular with my demographic, and its user base are very quick to share new and emerging content.

LimeWire has an option to monitor incoming searches, but this is capped at the 99 latest.

I think these search terms can be extremely beneficial to me in monitoring new trends, and I would like to capture these words into a database in an automatic and scalable fashion.

Does anybody know if such as piece of software exists? It doesn't have to be exclusively for LimeWire, but for any P2P network.

An ideal program would have an option to record only search terms that contain a specified keyword, and would offer figures of how many times a given keyword was searched for.

 

shorebreak




msg:3280582
 1:56 pm on Mar 13, 2007 (gmt 0)

You should talk to SkyRider, a startup that's helping advertisers get in front of P2P search queries. They have technology that allows them to 'convince' the peers on P2P networks to rank search results (including their sponsored ads) the way SkyRider wants.

Sequoia (#2-3 VC here in Silicon Valley) invested in them, and the team are folks who in the past started Narus and worked on NSA wiretapping projects - they know their networking protocols. CEO is Ed Kozel who sits on Yahoo's board.

I imagine that if they wanted to they could tell you the top 100K queries on the P2P newtorks.

-Shorebreak

nonni




msg:3283007
 6:17 pm on Mar 15, 2007 (gmt 0)

I did something like otem is talking about a few years ago. I downloaded an open source client for that network that ran on Linux (gnutella, I think). I turned up the bandwidth settings to pass lots of search messages. Then I redirected the search monitor to a text file. Easy. Megabytes of search data were soon on my drive. Then I used grep and other utilities to extract and count the occurences of terms I was interested in.

The new gnutella is gtk-gnutella - it has a graphic interface. I used the text-based client, as it had easier access to the underlying API.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Alternative Search Engines
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved