Matrix Mathematics

Preface to the Second Edition xv
Preface to the First Edition xvii
Special Symbols xxi
Conventions, Notation, and Terminology xxxiii


Chapter 1: Preliminaries 1
1.1 Logic 1
1.2 Sets 2
1.3 Integers, Real Numbers, and Complex Numbers 3
1.4 Functions 4
1.5 Relations 6
1.6 Graphs 9
1.7 Facts on Logic, Sets, Functions, and Relations 11
1.8 Facts on Graphs 15
1.9 Facts on Binomial Identities and Sums 16
1.10 Facts on Convex Functions 23
1.11 Facts on Scalar Identities and Inequalities in One Variable 25
1.12 Facts on Scalar Identities and Inequalities in Two Variables 33
1.13 Facts on Scalar Identities and Inequalities in Three Variables 42
1.14 Facts on Scalar Identities and Inequalities in Four Variables 50
1.15 Facts on Scalar Identities and Inequalities in Six Variables 52
1.16 Facts on Scalar Identities and Inequalities in Eight Variables 52
1.17 Facts on Scalar Identities and Inequalities in n Variables 52
1.18 Facts on Scalar Identities and Inequalities in 2n Variables 66
1.19 Facts on Scalar Identities and Inequalities in 3n Variables 74
1.20 Facts on Scalar Identities and Inequalities in Complex Variables 74
1.21 Facts on Trigonometric and Hyperbolic Identities 81
1.22 Notes 84


Chapter 2: Basic Matrix Properties 85
2.1 Matrix Algebra 85
2.2 Transpose and Inner Product 92
2.3 Convex Sets, Cones, and Subspaces 97
2.4 Range and Null Space 101
2.5 Rank and Defect 104
2.6 Invertibility 106
2.7 The Determinant 111
2.8 Partitioned Matrices 115
2.9 Facts on Polars, Cones, Dual Cones, Convex Hulls, and Subspaces 119
2.10 Facts on Range, Null Space, Rank, and Defect 124
2.11 Facts on the Range, Rank, Null Space, and Defect of Partitioned Matrices 130
2.12 Facts on the Inner Product, Outer Product, Trace, and Matrix Powers 136
2.13 Facts on the Determinant 139
2.14 Facts on the Determinant of Partitioned Matrices 144
2.15 Facts on Left and Right Inverses 152
2.16 Facts on the Adjugate and Inverses 153
2.17 Facts on the Inverse of Partitioned Matrices 159
2.18 Facts on Commutators 161
2.19 Facts on Complex Matrices 164
2.20 Facts on Geometry 167
2.21 Facts on Majorization 175
2.22 Notes 178


Chapter 3: Matrix Classes and Transformations 179
3.1 Matrix Classes 179
3.2 Matrices Related to Graphs 184
3.3 Lie Algebras and Groups 185
3.4 Matrix Transformations 188
3.5 Projectors, Idempotent Matrices, and Subspaces 190
3.6 Facts on Group-Invertible and Range-Hermitian Matrices 191
3.7 Facts on Normal, Hermitian, and Skew-Hermitian Matrices 192
3.8 Facts on Commutators 199
3.9 Facts on Linear Interpolation 200
3.10 Facts on the Cross Product 202
3.11 Facts on Unitary and Shifted-Unitary Matrices 205
3.12 Facts on Idempotent Matrices 215
3.13 Facts on Projectors 223
3.14 Facts on Reflectors 229
3.15 Facts on Involutory Matrices 230
3.16 Facts on Tripotent Matrices 231
3.17 Facts on Nilpotent Matrices 232
3.18 Facts on Hankel and Toeplitz Matrices 234
3.19 Facts on Tridiagonal Matrices 237
3.20 Facts on Hamiltonian and Symplectic Matrices 238
3.21 Facts on Matrices Related to Graphs 240
3.22 Facts on Triangular, Irreducible, Cauchy, Dissipative, Contractive, and Centrosymmetric Matrices 240
3.23 Facts on Groups 242
3.24 Facts on Quaternions 247
3.25 Notes 252


Chapter 4: Polynomial Matrices and Rational Transfer Functions 253
4.1 Polynomials 253
4.2 Polynomial Matrices 256
4.3 The Smith Decomposition and Similarity Invariants 258
4.4 Eigenvalues 261
4.5 Eigenvectors 267
4.6 The Minimal Polynomial 269
4.7 Rational Transfer Functions and the Smith-McMillan Decomposition 271
4.8 Facts on Polynomials and Rational Functions 276
4.9 Facts on the Characteristic and Minimal Polynomials 282
4.10 Facts on the Spectrum 288
4.11 Facts on Graphs and Nonnegative Matrices 297
4.12 Notes 307


Chapter 5: Matrix Decompositions 309
5.1 Smith Form 309
5.2 Multicompanion Form 309
5.3 Hypercompanion Form and Jordan Form 314
5.4 Schur Decomposition 318
5.5 Eigenstructure Properties 321
5.6 Singular Value Decomposition 328
5.7 Pencils and the Kronecker Canonical Form 330
5.8 Facts on the Inertia 334
5.9 Facts on Matrix Transformations for One Matrix 338
5.10 Facts on Matrix Transformations for Two or More Matrices 345
5.11 Facts on Eigenvalues and Singular Values for One Matrix 350
5.12 Facts on Eigenvalues and Singular Values for Two or More Matrices 362
5.13 Facts on Matrix Pencils 369
5.14 Facts on Matrix Eigenstructure 369
5.15 Facts on Matrix Factorizations 377
5.16 Facts on Companion, Vandermonde, Circulant, and Hadamard Matrices 385
5.17 Facts on Simultaneous Transformations 391
5.18 Facts on the Polar Decomposition 393
5.19 Facts on Additive Decompositions 394
5.20 Notes 396


Chapter 6: Generalized Inverses 397
6.1 Moore-Penrose Generalized Inverse 397
6.2 Drazin Generalized Inverse 401
6.3 Facts on the Moore-Penrose Generalized Inverse for One Matrix 404
6.4 Facts on the Moore-Penrose Generalized Inverse for Two or
More Matrices 411
6.5 Facts on the Moore-Penrose Generalized Inverse for Partitioned Matrices 422
6.6 Facts on the Drazin and Group Generalized Inverses 431
6.7 Notes 438


Chapter 7: Kronecker and Schur Algebra 439
7.1 Kronecker Product 439
7.2 Kronecker Sum and Linear Matrix Equations 443
7.3 Schur Product 444
7.4 Facts on the Kronecker Product 445
7.5 Facts on the Kronecker Sum 450
7.6 Facts on the Schur Product 454
7.7 Notes 458


Chapter 8: Positive-Semidefinite Matrices 459
8.1 Positive-Semidefinite and Positive-Definite Orderings 459
8.2 Submatrices 461
8.3 Simultaneous Diagonalization 465
8.4 Eigenvalue Inequalities 467
8.5 Exponential, Square Root, and Logarithm of Hermitian Matrices 473
8.6 Matrix Inequalities 474
8.7 Facts on Range and Rank 486
8.8 Facts on Structured Positive-Semidefinite Matrices 488
8.9 Facts on Identities and Inequalities for One Matrix 495
8.10 Facts on Identities and Inequalities for Two or More Matrices 501
8.11 Facts on Identities and Inequalities for Partitioned Matrices 514
8.12 Facts on the Trace 523
8.13 Facts on the Determinant 533
8.14 Facts on Convex Sets and Convex Functions 543
8.15 Facts on Quadratic Forms 550
8.16 Facts on the Gaussian Density 556
8.17 Facts on Simultaneous Diagonalization 558
8.18 Facts on Eigenvalues and Singular Values for One Matrix 559
8.19 Facts on Eigenvalues and Singular Values for Two or More Matrices 564
8.20 Facts on Alternative Partial Orderings 574
8.21 Facts on Generalized Inverses 577
8.22 Facts on the Kronecker and Schur Products 584
8.23 Notes 595


Chapter 9: Norms 597
9.1 Vector Norms 597
9.2 Matrix Norms 601
9.3 Compatible Norms 604
9.4 Induced Norms 607
9.5 Induced Lower Bound 613
9.6 Singular Value Inequalities 615
9.7 Facts on Vector Norms 618
9.8 Facts on Matrix Norms for One Matrix 627
9.9 Facts on Matrix Norms for Two or More Matrices 636
9.10 Facts on Matrix Norms for Partitioned Matrices 649
9.11 Facts on Matrix Norms and Eigenvalues for One Matrix 653
9.12 Facts on Matrix Norms and Eigenvalues for Two or More Matrices 656
9.13 Facts on Matrix Norms and Singular Values for One Matrix 659
9.14 Facts on Matrix Norms and Singular Values for Two or More
Matrices 665
9.15 Facts on Linear Equations and Least Squares 676
9.16 Notes 680


Chapter 10: Functions of Matrices and Their Derivatives 681
10.1 Open Sets and Closed Sets 681
10.2 Limits 682
10.3 Continuity 684
10.4 Derivatives 685
10.5 Functions of a Matrix 688
10.6 Matrix Square Root and Matrix Sign Functions 690
10.7 Matrix Derivatives 690
10.8 Facts on One Set 693
10.9 Facts on Two or More Sets 695
10.10 Facts on Matrix Functions 698
10.11 Facts on Functions 699
10.12 Facts on Derivatives 701
10.13 Facts on Infinite Series 704
10.14 Notes 705


Chapter 11: The Matrix Exponential and Stability Theory 707
11.1 Definition of the Matrix Exponential 707
11.2 Structure of the Matrix Exponential 710
11.3 Explicit Expressions 715
11.4 Matrix Logarithms 718
11.5 Principal Logarithm 720
11.6 Lie Groups 722
11.7 Lyapunov Stability Theory 725
11.8 Linear Stability Theory 726
11.9 The Lyapunov Equation 730
11.10 Discrete-Time Stability Theory 734
11.11 Facts on Matrix Exponential Formulas 736
11.12 Facts on the Matrix Sine and Cosine 742
11.13 Facts on the Matrix Exponential for One Matrix 743
11.14 Facts on the Matrix Exponential for Two or More Matrices 746
11.15 Facts on the Matrix Exponential and Eigenvalues, Singular Values, and Norms for One Matrix 756
11.16 Facts on the Matrix Exponential and Eigenvalues, Singular Values, and Norms for Two or More Matrices 759
11.17 Facts on Stable Polynomials 763
11.18 Facts on Stable Matrices 766
11.19 Facts on Almost Nonnegative Matrices 774
11.20 Facts on Discrete-Time-Stable Polynomials 777
11.21 Facts on Discrete-Time-Stable Matrices 782
11.22 Facts on Lie Groups 786
11.23 Facts on Subspace Decomposition 786
11.24 Notes 793


Chapter 12: Linear Systems and Control Theory 795
12.1 State Space and Transfer Function Models 795
12.2 Laplace Transform Analysis 798
12.3 The Unobservable Subspace and Observability 800
12.4 Observable Asymptotic Stability 805
12.5 Detectability 807
12.6 The Controllable Subspace and Controllability 808
12.7 Controllable Asymptotic Stability 816
12.8 Stabilizability 820
12.9 Realization Theory 822
12.10 Zeros 830
12.11 H2 System Norm 838
12.12 Harmonic Steady-State Response 841
12.13 System Interconnections 842
12.14 Standard Control Problem 845
12.15 Linear-Quadratic Control 847
12.16 Solutions of the Riccati Equation 850
12.17 The Stabilizing Solution of the Riccati Equation 855
12.18 The Maximal Solution of the Riccati Equation 859
12.19 Positive-Semidefinite and Positive-Definite Solutions of the Riccati Equation 862
12.20 Facts on Stability, Observability, and Controllability 863
12.21 Facts on the Lyapunov Equation and Inertia 866
12.22 Facts on Realizations and the H2 System Norm 872
12.23 Facts on the Riccati Equation 875
12.24 Notes 879


Bibliography 881
Author Index 967
Index 979