Prove that for any square matrix A, the eigenvalues of AAᵀ and AᵀA are the same (excluding zero).

Answer: The non-zero eigenvalues of AATAA^T and ATAA^TA are the same.

Step-by-step solution

Step 1: Define Eigenvalues and Eigenvectors

An eigenvalue λ\lambda of a matrix MM is a scalar such that there exists a non-zero vector vv (called an eigenvector) satisfying the equation Mv=λvMv = \lambda v. We want to show that the non-zero eigenvalues of AATAA^T and ATAA^TA are identical.

Step 2: Consider an Eigenvalue of ATAA^TA

Let λ\lambda be a non-zero eigenvalue of ATAA^TA with a corresponding eigenvector vv. This means ATAv=λvA^TAv = \lambda v, where v≠0v \neq 0.

Step 3: Multiply by A

Multiply both sides of the equation ATAv=λvA^TAv = \lambda v by AA from the left. This gives A(ATAv)=A(λv)A(A^TAv) = A(\lambda v), which simplifies to (AAT)(Av)=λ(Av)(AA^T)(Av) = \lambda (Av).

Step 4: Show AvAv is an Eigenvector of AATAA^T

For AvAv to be an eigenvector of AATAA^T, it must be non-zero. Since λ≠0\lambda \neq 0 and ATAv=λvA^TAv = \lambda v, if Av=0Av = 0, then AT(0)=λvA^T(0) = \lambda v, which implies 0=λv0 = \lambda v. Since λ≠0\lambda \neq 0, this would mean v=0v = 0, contradicting our assumption that vv is a non-zero eigenvector. Therefore, Av≠0Av \neq 0.

Step 5: Conclusion for one direction

Since Av≠0Av \neq 0, the equation (AAT)(Av)=λ(Av)(AA^T)(Av) = \lambda (Av) shows that λ\lambda is an eigenvalue of AATAA^T with AvAv as its corresponding eigenvector. This proves that every non-zero eigenvalue of ATAA^TA is also an eigenvalue of AATAA^T.

Step 6: Symmetry of the Proof

The proof is symmetric. Let μ\mu be a non-zero eigenvalue of AATAA^T with eigenvector ww. Then AATw=μwAA^Tw = \mu w. Multiplying by ATA^T from the left gives AT(AATw)=AT(μw)A^T(AA^Tw) = A^T(\mu w), which simplifies to (ATA)(ATw)=μ(ATw)(A^TA)(A^Tw) = \mu (A^Tw). Similar to the previous steps, we can show that ATw≠0A^Tw \neq 0. Thus, every non-zero eigenvalue of AATAA^T is also an eigenvalue of ATAA^TA.

More from this chapter

All Matrices solutions →

Solve your own maths question free →