Skip to main content
Log in

Properties of a representation of a basis for the null space

  • Published:
Mathematical Programming Submit manuscript

    We’re sorry, something doesn't seem to be working properly.

    Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.

Abstract

Given a rectangular matrixA(x) that depends on the independent variablesx, many constrained optimization methods involve computations withZ(x), a matrix whose columns form a basis for the null space ofA T(x). WhenA is evaluated at a given point, it is well known that a suitableZ (satisfyingA T Z = 0) can be obtained from standard matrix factorizations. However, Coleman and Sorensen have recently shown that standard orthogonal factorization methods may produce orthogonal bases that do not vary continuously withx; they also suggest several techniques for adapting these schemes so as to ensure continuity ofZ in the neighborhood of a given point.

This paper is an extension of an earlier note that defines the procedure for computingZ. Here, we first describe howZ can be obtained byupdating an explicit QR factorization with Householder transformations. The properties of this representation ofZ with respect to perturbations inA are discussed, including explicit bounds on the change inZ. We then introduceregularized Householder transformations, and show that their use implies continuity of the full matrixQ. The convergence ofZ andQ under appropriate assumptions is then proved. Finally, we indicate why the chosen form ofZ is convenient in certain methods for nonlinearly constrained optimization.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • R.H. Byrd and R.B. Schnabel, “Continuity of the null space basis and constrained optimization”, Report CU-CS-272-84, Department of Computer Science, University of Colorado (Boulder, CO, 1984).

    Google Scholar 

  • T.F. Coleman and A.R. Conn, “Nonlinear programming via an exact penalty function: Asymptotic analysis”,Mathematical Programming 24 (1982) 123–136.

    Google Scholar 

  • T.F. Coleman and A.R. Conn, “On the local convergence of a quasi-Newton method for the nonlinear programming problem”,SIAM Journal on Numerical Analysis 21 (1984) 755–769.

    Google Scholar 

  • T.F. Coleman and D.C. Sorensen, “A note on the computation of an orthogonal basis for the null space of a matrix”,Mathematical Programming 29 (1984) 234–242.

    Google Scholar 

  • C. Davis and W.M. Kahan, “The rotation of eigenvectors by a perturbation, III”,SIAM Journal on Numerical Analysis 7 (1970) 1–46.

    Google Scholar 

  • P.E. Gill, W. Murray, M.A. Saunders and M.H. Wright, “On the representation of a basis for the null space”, Report SOL 83-19, Department of Operations Research, Stanford University (Stanford, CA, 1983).

    Google Scholar 

  • P.E. Gill, W. Murray, M.A. Saunders and M.H. Wright, “Procedures for optimization problems with a mixture of bounds and general linear constraints”,ACM Transactions on Mathematical Software 10 (1984) 282–298.

    Google Scholar 

  • P.E. Gill, W. Murray, M.A. Saunders and M.H. Wright, “User's guide to SOL/QPSOL (Version 3.2)”, Report SOL 84-6, Department of Operations Research, Stanford University (Stanford, CA, 1984).

    Google Scholar 

  • P.E. Gill, W. Murray, M.A. Saunders and M.H. Wright, “User's guide to SOL/NPSOL (Version 2.1)”, Report SOL 84-7, Department of Operations Research, Stanford University (Stanford, CA, 1984).

    Google Scholar 

  • M.J.D. Powell, “Variable metric methods for constrained optimization”, in: A. Bachem, M. Grötschel and B. Korte, eds.,Mathematical programming: The state of the art (Springer-Verlag, Berlin, 1983) pp. 288–311.

    Google Scholar 

  • G.W. Stewart,Introduction to matrix computations (Academic Press, New York, 1973).

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Additional information

The research of the Stanford authors was supported by the U.S. Department of Energy Contract DE-AM03-76SF00326, PA No. DE-AT03-76ER72018; the National Science Foundation Grants MCS-7926009 and ECS-8312142; the Office of Naval Research Contract N00014-75-C-0267; and the U.S. Army Research Office Contract DAAG29-84-K-0156.

The research of G.W. Stewart was supported by the Air Force Office of Scientific Research Contract AFOSR-82-0078.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Gill, P.E., Murray, W., Saunders, M.A. et al. Properties of a representation of a basis for the null space. Mathematical Programming 33, 172–186 (1985). https://doi.org/10.1007/BF01582244

Download citation

  • Received:

  • Revised:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF01582244

Key words

Navigation