The data-analysis tag has no wiki summary.
3
votes
1answer
59 views
How to do local FFT on huge 3D vector data cell mesh and visualize it spatially?
Simulation type:
I'm running a simulation with the OOMMF micromagnetics package
http://math.nist.gov/oommf/
where are magnet is represented by a mesh of 3 million cells, it gets excited by a ...
1
vote
1answer
76 views
classification machinery needed
Consider a set of 7D vectors. Each vector belongs to one of four classes.
After mapping to 3D with PCA and coloring each point according its class the dataset looks like as shown below:
For the ...
1
vote
1answer
74 views
Clustering data based on the radius of a sphere
I have a data-set that has four columns [X Y Z C]. I would like to find all the C values that are in a given sphere centered at [X, Y, Z] with a radius r. What is the best approach to address this ...
4
votes
1answer
151 views
Recommendation for a python book for data processing
I've been doing FORTRAN programming for 10 years and I've started using python for a few years now, mostly for data processing. I've been lucky enough to work with people that are knowledgeable ...
1
vote
2answers
54 views
Estimate (non-)drift in noisy data
I have a time series representing the result of a complex calculation (physical simulation). Due to round-off errors and approximation errors, there will be some "noise" on the data series. In some ...
7
votes
3answers
281 views
Fastest PCA algorithm for high-dimensional data
I would like to perform a PCA on a dataset composed of approximately 40 000 samples, each sample displaying about 10 000 features.
Using Matlab princomp function consistently takes over half an hour ...
3
votes
1answer
48 views
Calculation of Multivariate Coherence
I trying to detecting whether a data set of time series has a global change in frequencies. Calculating the average (or median) pairwise coherence, I feel, misses the point because I am trying to get ...
2
votes
0answers
258 views
Can post-processing use topoSet and createPatch without screwing up the results?
I would like to use patchAverage to obtain the average pressure on an object that consists of multiple patches (due to different boundary conditions), however ...
8
votes
2answers
246 views
Best practice for storing hierarchical simulation data
TL,DR
What is the accepted best practice in scientific computing circles for storing large quantities of hierarchically structured data? For example, SQL does not play nicely with large sparse ...
9
votes
2answers
94 views
Matching Similar Items from a Set
I'm trying to match items. Given a set of $n$ items I can rank on a scale from 0 to 100 of how similar they are to one another. For instance, if item $n_1$ is milk and item $n_2$ is also milk, then ...
