Matrix determinant lemma

From HandWiki

In mathematics, in particular linear algebra, the matrix determinant lemma computes the determinant of the sum of an invertible matrix A and the dyadic product, uvT, of a column vector u and a row vector vT.[1][2]

Statement

Suppose A is an invertible square matrix and u, v are column vectors. Then the matrix determinant lemma states that

det(𝐀+𝐮𝐯T)=(1+𝐯T𝐀1𝐮)det(𝐀).

Here, uvT is the outer product of two vectors u and v.

The theorem can also be stated in terms of the adjugate matrix of A:

det(𝐀+𝐮𝐯T)=det(𝐀)+𝐯Tadj(𝐀)𝐮,

in which case it applies whether or not the square matrix A is invertible.

Proof

First the proof of the special case A = I follows from the equality:[3]

(𝐈0𝐯T1)(𝐈+𝐮𝐯T𝐮01)(𝐈0𝐯T1)=(𝐈𝐮01+𝐯T𝐮).

The determinant of the left hand side is the product of the determinants of the three matrices. Since the first and third matrix are triangular matrices with unit diagonal, their determinants are just 1. The determinant of the middle matrix is our desired value. The determinant of the right hand side is simply (1 + vTu). So we have the result:

det(𝐈+𝐮𝐯T)=(1+𝐯T𝐮).

Then the general case can be found as:

det(𝐀+𝐮𝐯T)=det(𝐀)det(𝐈+(𝐀1𝐮)𝐯T)=det(𝐀)(1+𝐯T(𝐀1𝐮)).

Application

If the determinant and inverse of A are already known, the formula provides a numerically cheap way to compute the determinant of A corrected by the matrix uvT. The computation is relatively cheap because the determinant of A + uvT does not have to be computed from scratch (which in general is expensive). Using unit vectors for u and/or v, individual columns, rows or elements[4] of A may be manipulated and a correspondingly updated determinant computed relatively cheaply in this way.

When the matrix determinant lemma is used in conjunction with the Sherman–Morrison formula, both the inverse and determinant may be conveniently updated together.

Generalization

Suppose A is an invertible n-by-n matrix and U, V are n-by-m matrices. Then

det(𝐀+𝐔𝐕T)=det(I𝐦+𝐕T𝐀1𝐔)det(𝐀).

In the special case 𝐀=I𝐧 this is the Weinstein–Aronszajn identity.

Given additionally an invertible m-by-m matrix W, the relationship can also be expressed as

det(𝐀+𝐔𝐖𝐕T)=det(𝐖1+𝐕T𝐀1𝐔)det(𝐖)det(𝐀).

See also

  • The Sherman–Morrison formula, which shows how to update the inverse, A−1, to obtain (A + uvT)−1.
  • The Woodbury formula, which shows how to update the inverse, A−1, to obtain (A + UCVT)−1.
  • The binomial inverse theorem for (A + UCVT)−1.

References

  1. Harville, D. A. (1997). Matrix Algebra From a Statistician's Perspective. New York: Springer-Verlag. ISBN 0-387-94978-X. 
  2. Brookes, M. (2005). "The Matrix Reference Manual (online)". http://www.ee.ic.ac.uk/hp/staff/dmb/matrix/intro.html. 
  3. Ding, J.; Zhou, A. (2007). "Eigenvalues of rank-one updated matrices with some applications". Applied Mathematics Letters 20 (12): 1223–1226. doi:10.1016/j.aml.2006.11.016. ISSN 0893-9659. 
  4. William H. Press; Brian P. Flannery; Saul A. Teukolsky; William T. Vetterling (1992). Numerical Recipes in C: The Art of Scientific Computing. Cambridge University Press. pp. 73. ISBN 0-521-43108-5.