6 votes

Simple way to store/read data from file in C++

Numpy has a file format that is pretty simple, which makes it perfectly compatible with basically every other high level language. (https://www.numpy.org/devdocs/reference/generated/numpy.lib.format....
Kirill's user avatar
  • 11.4k
5 votes

k nearest neighbors dictionary for vectors?

What you're describing is also a critical step in the k-nearest-neighbours method. So no need to reinvent the wheel, we can just look how other people have sped up that algorithm. I don't know about ...
Thijs Steel's user avatar
  • 1,693
4 votes

Robust alternative to HDF5 for storing large datasets

I think you put too much weight on your list of disadvantages. If you run up to the disk space limit, for example, does it really make a difference whether (i) half of the data is lost simply because ...
Wolfgang Bangerth's user avatar
4 votes

Best way to track parameters and results, in your experience (i.e. how do you do it)?

Since you've asked about experiences, I've seen all three of the methods you suggest used. However best practise is that inputs to the code, and the code framework itself are kept separate. This means ...
origimbo's user avatar
  • 2,249
2 votes

Simple way to store/read data from file in C++

Cereal is a straight-forward and easy-to-use serialization library for C++ data structures. It knows all of the STL data structures and adapting custom classes for use with it is easy. Example code: ...
Richard's user avatar
  • 3,961
2 votes

Simple way to store/read data from file in C++

You can use boost's serialization facilities, which can be straightforwardly extended to support custom data structures. If you use Eigen you can adapt something like this in order to suit your needs.
lr1985's user avatar
  • 677
2 votes

Best way to track parameters and results, in your experience (i.e. how do you do it)?

I don't know what you can do to keep track of parameters and results, though @origimbo correctly noted that repeatability kinda makes results useless to store. The first point you make is obviously ...
GoGoLander's user avatar
1 vote

Robust alternative to HDF5 for storing large datasets

Did you take a look into (Parallel) NetCDF? I am not sure, however, whether there is a handling for the issues that you mentioned which is guaranteed on all platforms and interfaces.
Dan Doe's user avatar
  • 1,083
1 vote

Best practice for storing hierarchical simulation data

The use of a database is great for helping you organize/find simulation data (Search by protein, search by simulation parameters). The database should then tell you where to find the relevant ...
Richmond Newman's user avatar

Only top scored, non community-wiki answers of a minimum length are eligible