Search Engine software

Searching less than 20 sites

[Lovejoy]

Hi All,

Anyone know of any search engine software that will allow me to spider a handful of sites? What I want to do is put together a highly specialized search engine for a very narrow niche. Only about 20 authority sites would need to be spidered, so it doesn't have to be very fast or powerful, but it does need to be Url specific for the sites I want it to index.

Lovejoy

[Woz]

You could always use the Google Custom Search Engine (CSE) which would return results only from the domains you specify, although you would only get URLs that are included within the Google index.

Onya
Woz

[Lovejoy]

The problem is I want to charge a fee for access, most likely by subscription and I don't think Google would like that ;~)

Lovejoy

[Woz]

Ahh, that does change the situation a tad. Although, you could always monetise the CSE with Adsense in lieu of an access fee.

I generally don't use third party scripts so cannot give an specific recommendation, however, the best list of such tools of which I am aware is over at Search Tools [searchtools.com], listing quite a variety of search scripts and appliances.

Onya
Woz

[Lovejoy]

Hi Woz,

Adsense for my stuff is self defeating, too small a niche @ 8 cents a click VS $5.95 per search ;~) I currently have a searchable database with much the same information I want to spider as a search engine that I charge a fee for access. Manually updating the database is very time consuming, and has to be done regularly because the information is time sensitive. I will check out you link and see what's available

Lovejoy