Internal SE for site search only

Any good freebee around?

[Macguru]

I need to use a search engine for internal website search. Never did this before. Site is about 10 000 pages. About 9 990 almost similar 'product desciption' pages for different products. All page titles fit products well.
Site is pure static HTML pages, hosted on *nix/apache server with all good wizzbang installed.

Can anyone recommend a good script/program to install a low maintenance SE on such a site?

[brotherhood of LAN]

Hi Macguru,

Have you tried FDSE? Im sure that is what WMW uses for site search. I also use it, and feel it is fine for anything on the smaller scale of things. I have heard it mentioned that this particular software has scalability issues, with 10000 pages being the number mentioned.

However, there are a number of admin options to tweak what is actually spidered...like file extensions, alt text, size of page etc etc etc, so I am sure you could "scale it" a little further.

You can try it out for free before you but (its not entirely open source...almost) and is written in Perl.

Its definetely an option. Oops, and its at xav.com/scripts

[Macguru]

Thanks brotherhood of LAN,

I will give it a try.

Gee, this place is better than Google to get all the good stuff, fast.

[scotty]

For freebies, there is ht://Dig [htdig.org], which I use for a couple of internal websites at work, as well as some of the public sites. I am currentlt using 3.2beta, and even though it might have problems sometimes spidering all the pages, but in general the search results are quite good. There are quite a few options that you can tune, like putting different weights on title, meta/keywords, h[1-6], links etc. It integrates well with my PHP based sites, and it is an open source software - free as in beer as well as in speech.

<url fixed -rcj>

(edited by: rcjordan at 1:02 pm (utc) on June 2, 2002)

[Macguru]

Thanks scotty,

The address provided does not resolve but I found the place with product name. I will give a try too. They have some other interesting stuff at this place.

[john316]

FDSE is good (fast) if you use the flat file option and is a great indexer (the spider is great), it gets kludgy on searches if you need to use MySql.

If you need to use MySql, I would use FDSE to spider the site and then use:

DGS Search - [digitalgenesis.com...]

for the actual search, it is php driven and way faster than FDSE (for MySql).

Another cool one (for flat files) is:

[risearch.org...]

[scotty]

Ooops. Sorry about the URL (and I see it is fixed now). Should have preview and check before I post...

[Dpeper]

Im Using www.Ksearch.com they have a free search script CGI, im instaling it right now but havent really had luck getting it to work but then again i dont know what im doing... It looks good if you use it let me know how it goes so mabey i can get mine working.

-Donny

-PS The examples of it that ive seen are very nice that is why i am recommending it.

[richlowe]

I use a CGI search called Perlfect. Very nice, easy to install and runs on my own server. I've also used Freefind and Atomz, both have paid versions which are good. A little expensive, though. I prefer having the search based on my own site.

Richard Lowe

[Macguru]

*BUMP*

I tried a couple of them to finally choosed FDSE. Installing it was a breeze and the client is very satisfied.

Thanks again guys!

[Birdman]

I'm currently trying to add this feature to a site, too. I can't figure out how to install though. Maybe I need to just contact the host. I did put a search from Mattsarchive just to see if I could get any CGI to work. I think it might be actually running, because it sengs me to the results page. I don't get any results, though. Could it be that my path is incorrect?

# Define Variables #

$basedir = '/home/';
$baseurl = 'http://www.mysite.com/';
@files = ('*.html');
$title = "Matt's Script Archive";
$title_url = 'http://www.mysite.com/';
$search_url = 'http://www.*****.com/demos/search/search.html';

# Done

Can anyone help?

[DaveAtIFG]

If the files you need to search are primarily in subdirectories, you may need to redifine your search array as detailed here [scriptarchive.com].