Keith Edmunds wrote:
> On Mon, 6 Aug 2007 14:05:11 +0100, james.dutton@??? said:
> 
>> Are there any tools out there to do this task, saving me reinventing the
>> wheel?
> 
> Have a look at htDig. It may be a package in your distribution, or you can
> find it at http://www.htdig.org/
Similar vintage as htDig is Glimpse. 
http://webglimpse.net/
I used it way back when to search/index a large number of files.  It 
works on a permuted index which you need to re-generate when you 
add/change the files being searched.  This is a bit of a pain, but it 
makes searching for all instances of "foobar" in 100,000 files very fast 
and it doesn't kill your disk while doing it.
YMMV
> 
> Keith
> 
-- 
Simple effective migration to Open Source based computing
Jim Kissel
Open Source Migrations Limited
w: 
http://www.osml.eu
e: jim.kissel@???
p: +44(0) 8703 301044
m: +44(0) 7976 411 679