Experiments on error growth associated with some linear least-squares procedures

Jordan, T. L.

doi:10.1090/S0025-5718-1968-0229373-X

Experiments on error growth associated with some linear least-squares procedures
HTML articles powered by AMS MathViewer

by T. L. Jordan PDF

Math. Comp. 22 (1968), 579-588 Request permission

Abstract:

Some numerical experiments were performed to compare the performance of procedures for solving the linear least-squares problem based on GramSchmidt, Modified Gram-Schmidt, and Householder transformations, as well as the classical method of forming and solving the normal equations. In addition, similar comparisons were made of the first three procedures and a procedure based on Gaussian elimination for solving an $n \times n$ system of equations. The results of these experiments suggest that: (1) the Modified Gram-Schmidt procedure is best for the least-squares problem and that the procedure based on Householder transformations performed competitively; (2) all the methods for solving least-squares problems suffer the effects of the condition number of $\begin {array}{*{20}{c}} A & {^T} & A \\ \end {array}$, although in a different manner for the first three procedures than for the fourth; and (3) the procedure based on Gaussian elimination is the most economical and essentially, the most accurate for solving $n \times n$ systems of linear equations. Some effects of pivoting in each of the procedures are included.

References

J. H. Wilkinson, Error analysis of direct methods of matrix inversion, J. Assoc. Comput. Mach. 8 (1961), 281–330. MR 176602, DOI 10.1145/321075.321076
G. H. Golub and J. H. Wilkinson, Note on the iterative refinement of least squares solution, Numer. Math. 9 (1966), 139–148. MR 212984, DOI 10.1007/BF02166032
G. Golub, Numerical methods for solving linear least squares problems, Numer. Math. 7 (1965), 206–216. MR 181094, DOI 10.1007/BF01436075
E. E. Osborne, Smallest least squares solutions of linear equations, J. Soc. Indust. Appl. Math. Ser. B Numer. Anal. 2 (1965), 300–307. MR 187382
Ȧke Björck, Solving linear least squares problems by Gram-Schmidt orthogonalization, Nordisk Tidskr. Informationsbehandling (BIT) 7 (1967), 1–21. MR 214275, DOI 10.1007/bf01934122
John R. Rice, Experiments on Gram-Schmidt orthogonalization, Math. Comp. 20 (1966), 325–328. MR 192673, DOI 10.1090/S0025-5718-1966-0192673-4