Use HDF5. Beats writing flat files hands down. And you can query. Docs are here
Here’s a perf comparison vs SQL. Updated to show SQL/HDF_fixed/HDF_table/CSV write and read perfs.
Docs now include a performance section:
See here
Use HDF5. Beats writing flat files hands down. And you can query. Docs are here
Here’s a perf comparison vs SQL. Updated to show SQL/HDF_fixed/HDF_table/CSV write and read perfs.
Docs now include a performance section:
See here