Regression analysis is the process of measuring and establishing a relationship between a dependent variable and one or more independent variables.

learn more… | top users | synonyms (1)

0
votes
0answers
23 views

ice (sleet, glaze ice) [on hold]

Tell me how you can well predict the ice (sleet, glaze ice)? I have a database for a long period of time with different parameters to weather conditions. The first thing that comes to mind - Least ...
1
vote
0answers
18 views

linear solution of curve fitting on multiple linear functions differing by a multiplier

I am facing the following problem. I know nonlinear least squares can provide a solution but I am wondering if a linear way to solve this data fitting problem may exists. This is my input dataset: ...
3
votes
2answers
99 views

Surface fitting

I do not need a complete answer but just some advice. I have a sparse matrix of points in a volume. I know a surface passing by these points exists and this surface is mostly flat and relatively ...
2
votes
0answers
102 views

Polynomial Fitting with Least Squares using Numpy and Scipy

I am trying to fit data to a polynomial using Python - Numpy. The points, with lines sketched above them are as in the picture. I am trying to fit those points to a polynomial of 4. or 5. degree. ...
1
vote
1answer
70 views

what went wrong with my logistic regression implementation in c++?

I have implemented a simple logistic regression function with IRLS algorithm using the armadillo linear algebra libray ...
1
vote
1answer
60 views

Least Angle when $\textbf{A}^T\textbf{A}$ is singular

I'm teaching myself this regression stuff, so forgive me if this is a basic question. I can't seem to find a discussion of my particular problem. So I'm least-squares-ing this overdetermined system ...
3
votes
0answers
57 views

Why not use this simpler variant of Stepwise Regression?

In stepwise regression, you step predictor by predictor, each time selecting the one with the greatest correlation with the measurement, subtracting greedily to leave a residual with no correlation to ...
1
vote
2answers
733 views

Tikhonov regularization in the non-negative least square - NNLS (python:scipy)

I am working on a project that I need to add a regularization into the NNLS algorithm. Is there a way to add the Tikhonov regularization into the NNLS implementation of scipy [1]? [2] talks about it, ...
3
votes
2answers
188 views

Can the Levenberg-Marquardt algorithm be used for minimization and not fitting

Can the Levenberg-Marquardt algorithm be used for minimization and not fitting? Usually we input the derivative of the function we want to fit in the minimizer. Now if I assume I have an objective ...
2
votes
1answer
110 views

Some questions about MINPACK usage and messages

I am trying to use the nonlinear fitting routines of MINPACK for fitting a rather complicated equation of state to a set of experimental data. A subset of the data is fitted fairly well to a ...
0
votes
0answers
55 views

In training NN (MLP) based regressions, does local oversampling lead to biases?

I'm using an artificial neural network (ANN) to train a regression analysis. More specifically, I use a simple 3-layer multi-layer perceptron (MLP) with 5–10 input nodes, 10 nodes in the hidden ...
2
votes
1answer
152 views

How to detect specific behavior in time series?

I was not quite sure what the right SE for this was, so I posted this also here on DSP. Please tell me which one to remove :) Problem statement I have a few hundred unrelated time series, say ...
0
votes
0answers
19 views

Finding the optimum combination of raters that maximizes a quantity

0 down vote favorite I use 48 energy functions to score protein-ligand interactions. I have a dataset of protein-ligands for which I know the experimental binding energy, so I can compare it with the ...
3
votes
0answers
36 views

Partitioning Data for Multiple Regression Lines

We're all familiar with traditional least-squares method for constructing a straight line through a set of data points. The question is: suppose I show you a scatter plot which clearly is suggestive ...
1
vote
0answers
65 views

Differential equation - Model Fitting

My question is a quite simple one about statistics. I need to know the following thing. I have a differential equation from my model which I can solve. Now I can compare this solution with the ...
3
votes
2answers
52 views

Parameter Fitting: Need measure of data 'support' for a parameter solution

I am estimating parameters on a dataset that would, for the most part, result in a weakly constrained solution. The dataset however also contains a few more data points that make the solution ...
3
votes
1answer
196 views

Fitting one set of points to another by a rigid motion

I'm not really sure how to explain this problem clearly, so please bear with me. I have a basis of 3 orthonormal unit vectors and a position, a standard 4x4 transform matrix in computer graphics. ...
3
votes
1answer
41 views

How to obtain the minimum set of variables required in a model to produce accurate estimation?

I have a system which I assume is linear. I have a matrix $A$ of which each row is a coefficient of a unknown variables in vector $x$. I have vector $B$ which contains the result of each $Ax$. ...
3
votes
3answers
195 views

Averaging scattered data

I have multiple sets of measured data that can easily be visualized using a scatter plot (red and black points in the figure). If my measurements were perfect, the red and black points should lie on a ...
6
votes
4answers
680 views

parameters estimation

I have to estimate a parameter (K), but I don't know how I can do it. I think by a regression model (minimum least square?), but I'm not sure. The system is: ...
1
vote
0answers
75 views

Determining optimal number of clusters and Davies–Bouldin Index?

I'm trying to evaluate what is the right number of cluster needed for clusterize some data. I know that this is possible using Davies–Bouldin Index (DBI). To using DBI you have to compute it for any ...
3
votes
2answers
389 views

How to compute the optimal ridge regression model

I found R function ridge.cv very useful. I would like to implement the equivalent function in MATLAB. As a starting point, I used MATLAB function ...
3
votes
2answers
239 views

When fitting a Gaussian-like function, how does the amount of baseline datapoints affect the fit?

I am fitting a curve to some instrument data. The data is a pulse with a particular functional form, which starts from and returns to a constant (with noise) baseline level before and after the pulse. ...
10
votes
2answers
100 views

Matching Similar Items from a Set

I'm trying to match items. Given a set of $n$ items I can rank on a scale from 0 to 100 of how similar they are to one another. For instance, if item $n_1$ is milk and item $n_2$ is also milk, then ...
11
votes
2answers
579 views

Reporting curve-fit results in a scientific paper

(I hope this question fits this site; if not, accept my apologies). I ran a certain simulation, and got a time series y(t), t = 0, 1, ... 20. After trying some functions, I found that: ...
3
votes
1answer
155 views

Recover curves from noisy collection of points

Background: I'm trying to make a system that tracks a number of bubbles in a video I'm implementing the bubble detection in the single image case using the Circular Hough Transform. Due to ...
5
votes
2answers
197 views

Linear regression with quadratic constraints

What methods are suggested to solve problems of the form $\min || {A} x - y ||_k$, subject to $x^T P x \leq c$, and/or $x^T Q x = d$?
4
votes
2answers
75 views

What are all of the different methods for parameterizing an amino acid (or other small molecule)?

What are all of the different ways to derive the partial charges, van der Waals interactions, bond lengths, etc. of an amino acid (in other words, all of the parameters that could be used in a ...
2
votes
1answer
182 views

Polynomial Regression using Semidefinite Programming

I'm trying to design the frequency response function for a low-pass filter. I need the function to be polynomial and to fulfill the following constraints: the coefficients must sum to 1, the function ...
3
votes
1answer
253 views

Fitting a grid to an STM image

Suppose I have a scan from an STM image (very much like the things you see here). Suppose I have a simple square lattice with lattice parameter a. What I'd like to do is to numerically find the ...
8
votes
2answers
454 views

Kolmogorov–Smirnov test for multivariate data

I have a set of files consisting of randomly selected points from a dataset, each file belonging to a particular class. Each row in these files contains the coordinates in n-space of the point. I'd ...
4
votes
2answers
253 views

best way to optimize a function with linear/non-linear parameters

I am trying to fit some raw data using a function of the form $f(r) = \sum_{i=1}^{K} d_kS_k(n_k,\alpha_k,r)$ where $S_k(n_k,\alpha_k,r) = \frac{\alpha_k ^{n_k+3}}{(n_k+2)!}r^{n_k}\exp(-\alpha_kr)$ ...
7
votes
3answers
314 views

What should be the criteria for accepting/rejecting singular values?

I am solving a system using singular value decomposition. The singular values (before scaling) are: ...
10
votes
2answers
363 views

Quickly finding rough lines in sets of points

In a particular class of detector our data comes out as pairs of points in two dimensions, and we want to string these points into lines. The data is noisy, and is binned in one direction but not in ...
3
votes
2answers
377 views

Linear regression via SVD not producing best fit with escalating polynomial degree

I am using a basic singular value decomposition (via LAPACK) routine in FORTRAN to solve an overdetermined system in the form of $A\cdot X = B$ where $\mathrm{size}(A) = [m,n]$ with $m > n$. My ...