[Sigia-l] low-end (ish) search/spider combo

[Andrew McNaughton]

With unix servers, my pick would be to start out with ht://dig.  It's
pretty much my default engine to install when people aren't very clear on
their requirements, which gives them something to talk around, defining
what the want by contrast.

http://www.htdig.org/

It's reasonably easy to install and well documented.  It will crawl
multiple sites as defined by you, bringing the results into a single
index, but allowing a particular search form to specify a particular part
of the URL space to search.

Andrew





On Tue, 16 Jul 2002, Ben Whalley wrote:

> Date: Tue, 16 Jul 2002 17:16:48 +0100
> From: Ben Whalley <b.whalley at ry.com>
> To: sigia-l at asis.org
> Subject: [Sigia-l] low-end (ish) search/spider combo
>
> Hi,
>
> We're working with a client at the moment who is in the process of
> rebuilding a number of sites and subsites which are owned by numerous
> individuals across the company (and around the world). They're all over
> the place at the moment and are working hard to sort it out, but in the
> meantime want to implement a search engine which will cover all of their
> content, even as it changes and develops, and allow the group site to be
> used as a kind of portal to the rest of the business.
>
> My first though is buy a neat little google-box but it's a little out of
> our price range here. Does anyone know other sensible options for
> spidering and returning results on multiple sites? Our budget will be
> about $1000-$2000.
>
> Thanks,
>
> Ben Whalley
> ry.com
> ------------
> When replying, please *trim your post* as much as possible.
>
> *Plain text, please; NO Attachments
>
> ASIST SIG IA website: http://www.asis.org/SIG/SIGIA/index.html
> _______________________________________________
> Sigia-l mailing list -- post to: Sigia-l at asis.org
> Changes to subscription: http://mail.asis.org/mailman/listinfo/sigia-l
>