===== Data Management =====

also take a look in [[fdm|sciencedata management]].


==== Compressing Data ====



=== hdf5 and in memory compression ===
https://www.hdfgroup.org/2018/06/hdf5-or-how-i-learned-to-love-data-compression-and-partial-i-o/