# Preconditioning and effects on precision of solution of LSE

In my courses on numerical analysis, I have been taught that the main and principal motivation for preconditioning linear systems of equations is to increase the convergence rate of iterative solvers for that LSE.

But, is there any effect on the precision of the computed solution?

I can remember a result on the precision of computed solution of Gaussian elimination, which can be found in Matrix Computations by Golub and Van Loan (p. 122). The condition number (with respect to some particular norm) does indeed affect the precision of the numerical solution computed by that algorithm.

One might expect that something similar holds for solutions obtained by, e.g., Conjugate Gradients. I think that I have observed this in a computational experiment. When I had the Conjugate gradient method run on an unpreconditioned system for a (long) time until some stopping criterion was met, the computed solution still displayed a high residual. So I wonder whether lower condition numbers not only lead to lower run-times, but also to a lower residual (or error) in the computed solution. Note that this is necessarily a question of numerical stability, which requires that we work in inprecise arithmetics.

(I have asked the same question on math.SE, but I think that this site might be more appropriate.)

• In fact Golub and Van Loan do give a short note n the effect of your matrix's $\kappa$ on the convergence rate; see this. Geometrically, you can think of it as the iteration struggling to proceed on a very narrow hyperellipsoid. May 14 '13 at 17:18
• You missed the point of my question, which might be due to left out word by me. I corrected it, please reread the question again now. - Note, that I do not ask for the convergence rate, but for the 'quality' of the solution, however one may define this. May 14 '13 at 19:31

Now for iterative methods: CG finds the best approximation over the subspace in the energy norm of the preconditioned operator. If the preconditioner is effective, then you can usually evaluate this norm more accurately. This is not guaranteed: the preconditioner is also ill-conditioned and in general, we can only evaluate $A B x$ with accuracy proportional to $\kappa(A) \kappa(B)$, not $\kappa(A B)$.