Questions tagged [data-analysis]

Data Analysis is the process of evaluating data using analytical and logical reasoning to examine each component of the data provided.

Filter by
Sorted by
Tagged with
1
vote
1answer
80 views

Line scan in a 2D histogram

So I have a 2D histogram, in the third dimention are the counts. What I want to achieve is by choosing two random position, make a plot of a 1D histogram along the line that passes through the two ...
11
votes
4answers
13k views

Fastest PCA algorithm for high-dimensional data

I would like to perform a PCA on a dataset composed of approximately 40 000 samples, each sample displaying about 10 000 features. Using Matlab princomp function consistently takes over half an hour ...
1
vote
1answer
72 views

Extract clusters from a graph of absolute-distance edge

I don't know if I have formulated this problem right: I have tons of items and the distances between each pair of them. Feeding this data into some visualization tool, I am able to create a nice ...
1
vote
0answers
41 views

Spectra of the energy flux VS transfer spectra?

In direct numerical simulation of turbulence what is the advantage to look at the spectra of the energy flux rather than the transfer spectra? The transfer spectra corresponds to the triple-velocity ...
1
vote
1answer
37 views

Adding data with different abscissas

This question may be better suited for an Astronomy Stack Exchange site, but I figured I'd ask here. Say I have measurements of something as a function of radius for a number of objects. Here's an ...
3
votes
2answers
66 views

Parameter Fitting: Need measure of data 'support' for a parameter solution

I am estimating parameters on a dataset that would, for the most part, result in a weakly constrained solution. The dataset however also contains a few more data points that make the solution well-...
2
votes
0answers
58 views

Error in treating non-uniformly spaced data as uniform

In discussing smoothing filters, Numerical Recipes p. 772 says ... irregularly sampled data, where the values $f_i$ are not uniformly spaced ... one can simply pretend that the data points are ...
3
votes
1answer
719 views

How to do local FFT on huge 3D vector data cell mesh and visualize it spatially?

Simulation type: I'm running a simulation with the OOMMF micromagnetics package http://math.nist.gov/oommf/ where are magnet is represented by a mesh of 3 million cells, it gets excited by a ...
1
vote
1answer
101 views

classification machinery needed

Consider a set of 7D vectors. Each vector belongs to one of four classes. After mapping to 3D with PCA and coloring each point according its class the dataset looks like as shown below: For the ...
1
vote
1answer
324 views

Clustering data based on the radius of a sphere

I have a data-set that has four columns [X Y Z C]. I would like to find all the C values that are in a given sphere centered at [X, Y, Z] with a radius r. What is the best approach to address this ...
5
votes
1answer
282 views

Recommendation for a python book for data processing

I've been doing FORTRAN programming for 10 years and I've started using python for a few years now, mostly for data processing. I've been lucky enough to work with people that are knowledgeable ...
2
votes
2answers
84 views

Estimate (non-)drift in noisy data

I have a time series representing the result of a complex calculation (physical simulation). Due to round-off errors and approximation errors, there will be some "noise" on the data series. In some ...
3
votes
1answer
127 views

Calculation of Multivariate Coherence

I trying to detecting whether a data set of time series has a global change in frequencies. Calculating the average (or median) pairwise coherence, I feel, misses the point because I am trying to get ...
2
votes
0answers
1k views

Can post-processing use topoSet and createPatch without screwing up the results?

I would like to use patchAverage to obtain the average pressure on an object that consists of multiple patches (due to different boundary conditions), however ...
10
votes
2answers
134 views

Matching Similar Items from a Set

I'm trying to match items. Given a set of $n$ items I can rank on a scale from 0 to 100 of how similar they are to one another. For instance, if item $n_1$ is milk and item $n_2$ is also milk, then ...

1
2