1
$\begingroup$

In cubic spline interpolation, we use the set of knots and function values $(x_i,y_i),i=1,...,n$ to construct a (tridiagonal) system of equations for the unknowns $\sigma_i$:

$$ h_{i-1}\sigma_{i-1} + 2(h_{i-1} + h_i)\sigma_i + h_i \sigma_{i+1} = \Delta_i - \Delta_{i-1} $$

where $h_i = x_{i+1} - x_i$ are the distances between knots, and $\Delta_i = (y_{i+1} - y_i)/(x_{i+1} - x_i)$ are approximations to the first derivatives. Upon solving the system of equations (together with suitable boundary equations), the values $\sigma_i = s''(x_i)/6$ (related to the second derivative of the cubic spline interpolant), together with the function values $y_i$ are used to form a piecewise cubic interpolant of the form: $$ s(x)=w y_{i+1} + \bar{w}y_i + h_i^2 \left[(w^3 - w)\sigma_{i+1} + (\bar{w}^3 - \bar{w})\sigma_i\right] $$ and $w = (x - x_i)/h_i$, $\bar{w} = 1-w$. For any choice of $x_1 < x_2 < ... < x_n$ the matrix of this system of equations will be nonsingular and diagonally dominant, meaning we can calculate a solution using Gaussian elimination without scaling or pivoting, and still obtain accurate results.

For general tridiagonal matrices LAPACK offers the routine dgtsv using LU factorization with pivoting. Intel MKL also offers the routine dtsvb for which does not perform pivoting (and therefore increases performance).

For certain types of boundary conditions (e.g. natural, or not-a-knot), on top of the diagonal dominance, the system of equations will also be symmetric. A specialized solver valid for symmetric, tridiagonal, and positive-definite systems is also available in LAPACK under dptsv (it computes a $LDL^T$ factorization). My primary source,

Forsythe, Malcolm, and Moler. Computer methods for Mathematical Computations. Prentice-Hall, 1977. (pg. 70-76)

does not indicate if the cubic spline system of equations is positive definite or not. I have found some references which state that for the B-spline basis, the collocation matrix is positive definite (see Novaković, 2018), however this appears to be a fundamentally different spline representation.

Is the positive-definite solver dptsv suitable for cubic spline interpolation in the form given above, or should I stick to the non-symmetric routines based upon LU factorization?


Edit: I have done the test suggested by Charlie S. It can be found in my gist.

The "not-a-knot" spline matrix is not positive definite: $$ \begin{pmatrix} -h_1 & h_1 & & & & 0 \\ h_1 & 2(h_1 + h_2) & h_2 \\ 0 & h_2 & 2(h_2 + h_3) & h_3 \\ & & \ddots & \ddots & \ddots \\ & & & h_{n-2} & 2(h_{n-2} + h_{n-1}) & h_{n-1} \\ 0 & & & & h_{n-1} & -h_{n-1} \end{pmatrix} \begin{pmatrix} \sigma_1 \\ \sigma_2 \\ \sigma_3 \\ \vdots \\ \sigma_{n-1} \\ \sigma_n \end{pmatrix} = \begin{pmatrix} h_1^2\Delta_1^{(3)}\\ \Delta_2 - \Delta_1 \\ \Delta_3 - \Delta_2 \\ \vdots \\ \Delta_{n-1} - \Delta_{n-2} \\ -h_{n-1}^2 \Delta_{n-3}^{(3)} \end{pmatrix} $$

The spline with natural boundary conditions $s''(x) = 0$ at the ends, meaning $\sigma_1 = \sigma_n = 0$, is positive definite (in agreement with the answer of Federico Poloni):

$$ \begin{pmatrix} 2(h_1 + h_2) & h_2 & & & 0\\ h_2 & 2(h_2 + h_3) & h_3 \\ & \ddots & \ddots & \ddots \\ & & h_{n-3} & 2(h_{n-3} + h_{n-2}) & h_{n-2} \\ 0 & & & h_{n-2} & 2(h_{n-2} + h_{n-1}) \end{pmatrix} \begin{pmatrix} \sigma_2 \\ \sigma_3 \\ \vdots \\ \sigma_{n-2} \\ \sigma_{n-1} \end{pmatrix} = \begin{pmatrix} \Delta_2 - \Delta_1 \\ \Delta_3 - \Delta_2 \\ \vdots \\ \Delta_{n-2} - \Delta_{n-3} \\ \Delta_{n-1} - \Delta_{n-2} \end{pmatrix} $$

For the natural cubic spline it is possible to use the symmetric routine dptsv.

Based on the answer of Federico Poloni, I suspect the periodic cubic spline will have a positive definite matrix too (but not tridiagonal).

$\endgroup$
3
  • $\begingroup$ No answer to your question -- but does it matter to use a slightly more specialized solution routine? $\endgroup$
    – davidhigh
    Nov 9, 2020 at 15:08
  • 2
    $\begingroup$ In my opinion, the primary benefit of using a symmetric representation and solver for a tridiagonal system would be the reduced memory requirements for the matrix. If your matrix is astoundingly gigantic, you could see some boost in performance. That said, the most practical method of testing whether a matrix is positive definite is attempting the factorization. Give it a shot and let us know what happens! $\endgroup$
    – Charlie S
    Nov 10, 2020 at 1:48
  • $\begingroup$ @CharlieS I have performed the test you suggested and edited my post. $\endgroup$
    – IPribec
    Nov 13, 2020 at 11:19

1 Answer 1

3
$\begingroup$

It would help if your question included the matrix written down in the usual format. In addition, it looks like there is a typo in your equation (the last $\sigma_i$ should be $\sigma_{i+1}$?)

Anyhow, if I guess correctly what you mean, your matrix is weakly diagonally dominant and irreducible, so by a corollary of Gershgorin's circle theorem 0 is an eigenvalue iff it belongs to the boundary of all circles, and the boundary conditions exclude it. Thus 0 is not an eigenvalue, and apart from 0 the circles are fully contained in the open right half-plane. This proves that your matrix is positive definite.

$\endgroup$
1
  • $\begingroup$ Based upon a numerical test, this appears to be true for cubic splines with natural boundary conditions. $\endgroup$
    – IPribec
    Nov 13, 2020 at 11:23

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.