Quote Originally Posted by SmUX2k View Post
I'd love to store it 1 month (or even 1 year) per DB,
but the problem is that DBs don't implement compression.
That's not really the case...
Most decent DB-engines can be configured for transparent compression (allowing direct queries)
at either row, column or page-level - (for example SQLite, MySQL, PostgreSQL and even MS-SQLServer).

The MS-Jet-Engine (*.mdb-Files) is one of the rare exceptions here, without any support for it...

That these compression-features (at DB-level) are not often known (or used) these days,
is due to transparent compression-support directly at FileSystem-Level -
(most modern Linux-FS' - but also MS-NTFS allow that with roughly similar compression-ratios as the DB-engines).

Sure, the choosen compression-algos for this kind of "live"-compression do not achieve rates as high as e.g. LZMA -
but their write/read throughput is ~400-800MB/sec (that's faster than the write/read rate of magnet-HDs).

So, with NTFS-Folder-based compression, you could interact and query your DB-data directly, in a decent performance -
at the cost of having only about half of the LZMA-compression-ratios.

Olaf