# Questions tagged [regression]

Regression analysis is the process of measuring and establishing a relationship between a dependent variable and one or more independent variables.

84 questions
Filter by
Sorted by
Tagged with
15 views

### Linear fitting of the data passing through origin on xmgrace [closed]

As far as I know, the linear fitting on xmgrace does the fitting of the data with the straight line of the form : y = mx +c, but is there any way I can fit the data with the straight line of the form: ...
75 views

### Finding a best fit line for the upper bound on an $x$ vs $y$ relationship

I am trying to do linear regression on the following conceptualized problem. I have a set of data in pairs $(x, y)$. I know that $y$ is bounded by a linear function $f(x) = mx + c$. I want to estimate ...
43 views

### SciPy ODR "Ordinary" Least Squares?

Scipy.odr has a setting for "fit types", including one for ordinary least-squares. This matches with the documentation of ODRPACK (see p. 31, Computational method). However, the package ...
1k views

The square root function for an old (pre-IEEE floating point, no hidden bit) mainframe (the Soviet BESM-6 works as follows: Making sure the argument $X$ is non-negative Splitting $X$ into the ...
1 vote
150 views

### Fitting line to a staircase function

I have a staircase/step function $n(E)$. I know the points $\{E_i\}$ at which each "step" occurs and all steps are of constant height 1. I need to fit a line $a + bE$ to this function and ...
130 views

### Parameters estimation with fewer variables than parameters

I am trying to estimate parameters, 4 of them, by fitting a system of 3 ordinary differential equations. I am using a model published that was using 3 parameters and gave a good fit to the data, and I ...
218 views

### Preconditioning vs. regularization

I used to be more of a numerical linear algebra and computational science person, but recently, I've crossed into stats and machine learning. For this discussion, let's focus on matrices that are not ...
1 vote
240 views

### How can we solve the normal equations with limited memory?

I was asked this open ended question in an interview once: How would you find a solution to the normal equations with limited memory? Unlike Solving sparse least squares system with limited memory, ...
1 vote
76 views

### Error curve does not oscillate in between reference points using Remez

Using the Remez algorithm, implemented using multi-precision library, in certain functions that I want to approximate, the error curve does not oscillate in between reference points, and so no roots ...
82 views

1k views

### Fitting Implicit Surfaces to Oriented Point Sets

I have a question regarding quadric fit to a set of points and corresponding normals (or equivalently, tangents). Fitting quadric surfaces to point data is well explored. Some works are as follows: ...
1 vote
242 views

### Data Analysis - Cooling Efficiency

I have a question as I am starting my dive into computational analysis. I have a large set of data (~2 months) which includes the room temperature, HVAC status (heat/cool/off) and the location of ...
1 vote
36 views

### Parameter identification for regression model

Consider the following regression model : Y = AX + BU where the size of Y is $N \times n$, A is $N \times n$, X is $n \times n$, B is $N \times n$ and U is $n \times 1$. The matrices X,Y and U are ...
1 vote
47 views

1 vote
733 views

### Constrained linear least squares matrix equation

It has been a while since I have done linear least squares, so forgive the simple question, but here goes: I am attempting to find the best fit coefficients, $\{c_i\}$, of a linear combination of ...
2k views

### How do I correctly multiply vectors and matrices in Python and MATLAB?

I have been trying for 2-3 days now to get L2 regularized logistric regression to work in Matlab (CVX) and Python(CVXPY) but no success. I am fairly new to convex optimization so I am quite frustrated....
I have data of the form: X Y 3.53 0 4.93 50 5.53 60 6.21 70 7.37 80 9.98 90 16.56 100 And I want to find out $n$ so that this can be ...