Search Engine Software

I was wondering if anyone knew of some existing search engine software for doing a directory search and streaming that information. I have tera bytes worth of data to comb through on a server and need to find things quickly. I tried using a very good recursive searching class I wrote and threaded it out. However it is still to slow to search the entire data structure. If anyone knows of anything from code on the net to an actual sdk search engine

Thanks

Any search service that you install on your server will still take just about the same amount of time. It needs to go through everything and index all the information that it can get so that when you use it to perform your search it can quickly access its own 'database' and give you the references you need.

There are the Windows Search SDK and Google Desktop APIs, though. See if it helps.