The data-storage tag has no wiki summary.
4
votes
3answers
419 views
Storing a large, sparse array for R and Python
I've been working in R but sometimes switching to python. I'd like a more inter-language portable way of storing a large array than a csv file. (The particular csv file I'm dealing with is about 10^6 ...
8
votes
2answers
247 views
Best practice for storing hierarchical simulation data
TL,DR
What is the accepted best practice in scientific computing circles for storing large quantities of hierarchically structured data? For example, SQL does not play nicely with large sparse ...
14
votes
3answers
483 views
Compressing floating point data
Are there any tools specifically designed for compressing floating point scientific data?
If a function is smooth, there's obviously a lot of correlation between the numbers representing that ...
4
votes
1answer
163 views
Working with multi-dimensional functions
How would you represent functions of type $[-1, 1]^n \to \mathbb R \;$ for moderate $n$? How would you integrate them?
For small $n$ (1-2) such functions can be represented as histograms, vectors in ...
