Skip to main content
Understanding Linear Algebra
David Austin
Contents
Index
Search Book
close
Search Results:
No results.
Prev
Up
Next
Scratch ActiveCode
Profile
Course Home
Assignments
Practice
Peer Instruction (Instructor)
Peer Instruction (Student)
Change Course
Instructor's Page
Progress Page
Edit Profile
Change Password
Log Out
\(\newcommand{\avec}{{\mathbf a}} \newcommand{\bvec}{{\mathbf b}} \newcommand{\cvec}{{\mathbf c}} \newcommand{\dvec}{{\mathbf d}} \newcommand{\dtil}{\widetilde{\mathbf d}} \newcommand{\evec}{{\mathbf e}} \newcommand{\fvec}{{\mathbf f}} \newcommand{\nvec}{{\mathbf n}} \newcommand{\pvec}{{\mathbf p}} \newcommand{\qvec}{{\mathbf q}} \newcommand{\svec}{{\mathbf s}} \newcommand{\tvec}{{\mathbf t}} \newcommand{\uvec}{{\mathbf u}} \newcommand{\vvec}{{\mathbf v}} \newcommand{\wvec}{{\mathbf w}} \newcommand{\xvec}{{\mathbf x}} \newcommand{\yvec}{{\mathbf y}} \newcommand{\zvec}{{\mathbf z}} \newcommand{\rvec}{{\mathbf r}} \newcommand{\mvec}{{\mathbf m}} \newcommand{\zerovec}{{\mathbf 0}} \newcommand{\onevec}{{\mathbf 1}} \newcommand{\real}{{\mathbb R}} \newcommand{\twovec}[2]{\left[\begin{array}{r}#1 \\ #2 \end{array}\right]} \newcommand{\ctwovec}[2]{\left[\begin{array}{c}#1 \\ #2 \end{array}\right]} \newcommand{\threevec}[3]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \end{array}\right]} \newcommand{\cthreevec}[3]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \end{array}\right]} \newcommand{\fourvec}[4]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \\ #4 \end{array}\right]} \newcommand{\cfourvec}[4]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \\ #4 \end{array}\right]} \newcommand{\fivevec}[5]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \\ #4 \\ #5 \\ \end{array}\right]} \newcommand{\cfivevec}[5]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \\ #4 \\ #5 \\ \end{array}\right]} \newcommand{\mattwo}[4]{\left[\begin{array}{rr}#1 \amp #2 \\ #3 \amp #4 \\ \end{array}\right]} \newcommand{\laspan}[1]{\text{Span}\{#1\}} \newcommand{\bcal}{{\cal B}} \newcommand{\ccal}{{\cal C}} \newcommand{\scal}{{\cal S}} \newcommand{\wcal}{{\cal W}} \newcommand{\ecal}{{\cal E}} \newcommand{\coords}[2]{\left\{#1\right\}_{#2}} \newcommand{\gray}[1]{\color{gray}{#1}} \newcommand{\lgray}[1]{\color{lightgray}{#1}} \newcommand{\rank}{\operatorname{rank}} \newcommand{\row}{\text{Row}} \newcommand{\col}{\text{Col}} \renewcommand{\row}{\text{Row}} \newcommand{\nul}{\text{Nul}} \newcommand{\var}{\text{Var}} \newcommand{\corr}{\text{corr}} \newcommand{\len}[1]{\left|#1\right|} \newcommand{\bbar}{\overline{\bvec}} \newcommand{\bhat}{\widehat{\bvec}} \newcommand{\bperp}{\bvec^\perp} \newcommand{\xhat}{\widehat{\xvec}} \newcommand{\vhat}{\widehat{\vvec}} \newcommand{\uhat}{\widehat{\uvec}} \newcommand{\what}{\widehat{\wvec}} \newcommand{\Sighat}{\widehat{\Sigma}} \newcommand{\lt}{<} \newcommand{\gt}{>} \newcommand{\amp}{&} \definecolor{fillinmathshade}{gray}{0.9} \newcommand{\fillinmath}[1]{\mathchoice{\colorbox{fillinmathshade}{$\displaystyle \phantom{\,#1\,}$}}{\colorbox{fillinmathshade}{$\textstyle \phantom{\,#1\,}$}}{\colorbox{fillinmathshade}{$\scriptstyle \phantom{\,#1\,}$}}{\colorbox{fillinmathshade}{$\scriptscriptstyle\phantom{\,#1\,}$}}} \)
Front Matter
Dedication
Colophon
Acknowledgements
Our goals
A note on the print version
1
Systems of equations
1.1
What can we expect
1.1.1
Some simple examples
1.1.2
Systems of linear equations
1.1.3
Summary
1.2
Finding solutions to linear systems
1.2.1
Gaussian elimination
1.2.2
Augmented matrices
1.2.3
Reduced row echelon form
1.2.4
Summary
1.2.5
Exercises
1.3
Computation with Sage
1.3.1
Introduction to Sage
1.3.2
Sage and matrices
1.3.3
Computational effort
1.3.4
Summary
1.3.5
Exercises
1.4
Pivots and their influence on solution spaces
1.4.1
The existence of solutions
1.4.2
The uniqueness of solutions
1.4.3
Summary
1.4.4
Exercises
2
Vectors, matrices, and linear combinations
2.1
Vectors and linear combinations
2.1.1
Vectors
2.1.2
Linear combinations
2.1.3
Summary
2.1.4
Exercises
2.2
Matrix multiplication and linear combinations
2.2.1
Scalar multiplication and addition of matrices
2.2.2
Matrix-vector multiplication and linear combinations
2.2.3
Matrix-vector multiplication and linear systems
2.2.4
Matrix-matrix products
2.2.5
Summary
2.2.6
Exercises
2.3
The span of a set of vectors
2.3.1
The span of a set of vectors
2.3.2
Pivot positions and span
2.3.3
Summary
2.3.4
Exercises
2.4
Linear independence
2.4.1
Linear dependence
2.4.2
How to recognize linear dependence
2.4.3
Homogeneous equations
2.4.4
Summary
2.4.5
Exercises
2.5
Matrix transformations
2.5.1
Matrix transformations
2.5.2
Composing matrix transformations
2.5.3
Discrete Dynamical Systems
2.5.4
Summary
2.5.5
Exercises
2.6
The geometry of matrix transformations
2.6.1
The geometry of
\(2\times2\)
matrix transformations
2.6.2
Matrix transformations and computer animation
2.6.3
Summary
2.6.4
Exercises
3
Invertibility, bases, and coordinate systems
3.1
Invertibility
3.1.1
Invertible matrices
3.1.2
Solving equations with an inverse
3.1.3
Triangular matrices and Gaussian elimination
3.1.4
Summary
3.1.5
Exercises
3.2
Bases and coordinate systems
3.2.1
Bases
3.2.2
Coordinate systems
3.2.3
Examples of bases
3.2.4
Summary
3.2.5
Exercises
3.3
Image compression
3.3.1
Color models
3.3.2
The JPEG compression algorithm
3.3.3
Summary
3.3.4
Exercises
3.4
Determinants
3.4.1
Determinants of
\(2\times2\)
matrices
3.4.2
Determinants and invertibility
3.4.3
Cofactor expansions
3.4.4
Summary
3.4.5
Exercises
3.5
Subspaces
3.5.1
Subspaces
3.5.2
The column space of
\(A\)
3.5.3
The null space of
\(A\)
3.5.4
Summary
3.5.5
Exercises
4
Eigenvalues and eigenvectors
4.1
An introduction to eigenvalues and eigenvectors
4.1.1
A few examples
4.1.2
The usefulness of eigenvalues and eigenvectors
4.1.3
Summary
4.1.4
Exercises
4.2
Finding eigenvalues and eigenvectors
4.2.1
The characteristic polynomial
4.2.2
Finding eigenvectors
4.2.3
The characteristic polynomial and the dimension of eigenspaces
4.2.4
Using Sage to find eigenvalues and eigenvectors
4.2.5
Summary
4.2.6
Exercises
4.3
Diagonalization, similarity, and powers of a matrix
4.3.1
Diagonalization of matrices
4.3.2
Powers of a diagonalizable matrix
4.3.3
Similarity and complex eigenvalues
4.3.4
Summary
4.3.5
Exercises
4.4
Dynamical systems
4.4.1
A first example
4.4.2
Classifying dynamical systems
4.4.3
A
\(3\times3\)
system
4.4.4
Summary
4.4.5
Exercises
4.5
Markov chains and Google’s PageRank algorithm
4.5.1
A first example
4.5.2
Markov chains
4.5.3
Google’s PageRank algorithm
4.5.4
Summary
4.5.5
Exercises
5
Linear algebra and computing
5.1
Gaussian elimination revisited
5.1.1
Partial pivoting
5.1.2
\(LU\)
factorizations
5.1.3
Summary
5.1.4
Exercises
5.2
Finding eigenvectors numerically
5.2.1
The power method
5.2.2
Finding other eigenvalues
5.2.3
Summary
5.2.4
Exercises
6
Orthogonality and Least Squares
6.1
The dot product
6.1.1
The geometry of the dot product
6.1.2
\(k\)
-means clustering
6.1.3
Summary
6.1.4
Exercises
6.2
Orthogonal complements and the matrix transpose
6.2.1
Orthogonal complements
6.2.2
The matrix transpose
6.2.3
Properties of the matrix transpose
6.2.4
Summary
6.2.5
Exercises
6.3
Orthogonal bases and projections
6.3.1
Orthogonal sets
6.3.2
Orthogonal projections
6.3.3
Summary
6.3.4
Exercises
6.4
Finding orthogonal bases
6.4.1
Gram-Schmidt orthogonalization
6.4.2
\(QR\)
factorizations
6.4.3
Summary
6.4.4
Exercises
6.5
Orthogonal least squares
6.5.1
A first example
6.5.2
Solving least-squares problems
6.5.3
Using
\(QR\)
factorizations
6.5.4
Polynomial Regression
6.5.5
Summary
6.5.6
Exercises
7
Singular value decompositions
7.1
Symmetric matrices and variance
7.1.1
Symmetric matrices and orthogonal diagonalization
7.1.2
Variance
7.1.3
Summary
7.1.4
Exercises
7.2
Quadratic forms
7.2.1
Quadratic forms
7.2.2
Definite symmetric matrices
7.2.3
Summary
7.2.4
Exercises
7.3
Principal Component Analysis
7.3.1
Principal Component Analysis
7.3.2
Using Principal Component Analysis
7.3.3
Summary
7.3.4
Exercises
7.4
Singular Value Decompositions
7.4.1
Finding singular value decompositions
7.4.2
The structure of singular value decompositions
7.4.3
Reduced singular value decompositions
7.4.4
Summary
7.4.5
Exercises
7.5
Using Singular Value Decompositions
7.5.1
Least-squares problems
7.5.2
Rank
\(k\)
approximations
7.5.3
Principal component analysis
7.5.4
Image compressing and denoising
7.5.5
Analyzing Supreme Court cases
7.5.6
Summary
7.5.7
Exercises
Back Matter
A
Sage Reference
Index
Colophon
Colophon
Colophon
This book was authored in PreTeXt.
