Preface Preface
This text is designed to teach the concepts and techniques of basic linear algebra as a rigorous mathematical subject. Besides computational proficiency, there is an emphasis on understanding definitions and theorems, as well as reading, understanding and creating proofs. A strictly logical organization, complete and exceedingly detailed proofs of every theorem, advice on techniques for reading and writing proofs, and a selection of challenging theoretical exercises will slowly provide the novice with the tools and confidence to be able to study other mathematical topics in a rigorous fashion.
Most students taking a course in linear algebra will have completed courses in differential and integral calculus, and maybe also multivariate calculus, and will typically be second-year students in university. This level of mathematical maturity is expected, however there is little or no requirement to know calculus itself to use this book successfully. With complete details for every proof, for nearly every example, and for solutions to a majority of the exercises, the book is ideal for self-study, for those of any age.
While there is an abundance of guidance in the use of the software system, Sage, there is no attempt to address the problems of numerical linear algebra, which are arguably continuous in nature. Similarly, there is little emphasis on a geometric approach to problems of linear algebra. While this may contradict the experience of many experienced mathematicians, the approach here is consciously algebraic. As a result, the student should be well-prepared to encounter groups, rings and fields in future courses in algebra, or other areas of discrete mathematics.
3
sagemath.orgHow to Use This Book.
While the book is divided into chapters, the main organizational unit is the thirty-seven sections. Each contains a selection of definitions, theorems, and examples interspersed with commentary. If you are enrolled in a course, read the section before class and then answer the section’s reading questions as preparation for class.
The version available for viewing in a web browser is the most complete, integrating all of the components of the book. Consider acquainting yourself with this version. Knowls are indicated by a dashed underlines and will allow you to seamlessly remind yourself of the content of definitions, theorems, examples, exercises, subsections and more. Use them liberally.
Historically, mathematics texts have numbered definitions and theorems. We have instead adopted a strategy more appropriate to the heavy cross-referencing, linking and knowling afforded by modern media. Mimicking an approach taken by Donald Knuth, we have given items short titles and associated acronyms. You will become comfortable with this scheme after a short time, and might even come to appreciate its inherent advantages. In the web version, each chapter has a list of ten or so important items from that chapter, and you will find yourself recognizing some of these acronyms with no extra effort beyond the normal amount of study. Bruno Mello suggests that some say an acronym should be pronouncable as a word (such as “radar”), and otherwise is an abbreviation. We will not be so strict in our use of the term.
Exercises come in three flavors, indicated by the first letter of their label. “C” indicates a problem that is essentially computational. “T” represents a problem that is more theoretical, usually requiring a solution that is as rigorous as a proof. “M” stands for problems that are “medium”, “moderate”, “midway”, “mediate” or “median”, but never “mediocre.” Their statements could feel computational, but their solutions require a more thorough understanding of the concepts or theory, while perhaps not being as rigorous as a proof. Of course, such a tripartite division will be subject to interpretation. Otherwise, larger numerical values indicate greater perceived difficulty, with gaps allowing for the contribution of new problems from readers. Many, but not all, exercises have complete solutions. These are indicated by daggers in the PDF and print versions, with solutions available in an online supplement, while in the web version a solution is indicated by a knowl right after the problem statement. Resist the urge to peek early. Working the exercises diligently is the best way to master the material.
The Archetypes are a collection of twenty-four archetypical examples. The open source lexical database, WordNet, defines an archetype as “something that serves as a model or a basis for making copies.” We employ the word in the first sense here. By carefully choosing the examples we hope to provide at least one example that is interesting and appropriate for many of the theorems and definitions, and also provide counterexamples to conjectures (and especially counterexamples to converses of theorems). Each archetype has numerous computational results which you could strive to duplicate as you encounter new definitions and theorems. There are some exercises which will help guide you in this quest.
Supplements.
Print versions of the book (either a physical copy or a PDF version) have significant material available as supplements. Solutions are contained in the Exercise Manual. Advice on the use of the open source mathematical software system, Sage, is contained in another supplement. (Look for a linear algebra “Quick Reference” sheet among the other quick reference sheets at the Sage wiki.) The Archetypes are available in a PDF form which could be used as a workbook. Flashcards, with the statement of every definition and theorem, in order of appearance, are also available.
4
sagemath.org5
wiki.sagemath.org/quickref6
wiki.sagemath.org/quickrefFreedom.
This book is copyrighted by its author. Some would say it is his “intellectual property,” a distasteful phrase if there ever was one. Rather than exercise all the restrictions provided by the government-granted monopoly that is copyright, the author has granted you a license, the GNU Free Documentation License (GFDL), which is contained in its entirety in Appendix GFDL. In summary, it says you may receive an electronic copy at no cost via electronic networks and you may make copies forever. So your copy of the book never has to go “out-of-print.” You may redistribute copies and you may make changes to your copy for your own use. However, you have one major responsibility in accepting this license. If you make changes and distribute the changed version, then you must offer the same license for the new version, you must acknowledge the original author’s work, and you must indicate where you have made changes.
In practice, if you see a change that needs to be made (like correcting an error, or adding a particularly nice theoretical exercise), you may just wish to donate the change to the author rather than create and maintain a new version. Such donations are highly encouraged and gratefully accepted. You may notice the large number of small mistakes that have been corrected by readers that have come before you. Pay it forward.
So, in one word, the book really is “free” (as in “no cost”). But the open license employed is vastly different than “free to download, all rights reserved.” Most importantly, you know that this book, and its ideas, are not the property of anyone. Or they are the property of everyone. Either way, this book has its own inherent “freedom,” separate from those who contribute to it. Much of this philosophy is embodied in the following quote:
If nature has made any one thing less susceptible than all others of exclusive property, it is the action of the thinking power called an idea, which an individual may exclusively possess as long as he keeps it to himself; but the moment it is divulged, it forces itself into the possession of every one, and the receiver cannot dispossess himself of it. Its peculiar character, too, is that no one possesses the less, because every other possesses the whole of it. He who receives an idea from me, receives instruction himself without lessening mine; as he who lights his taper at mine, receives light without darkening me. That ideas should freely spread from one to another over the globe, for the moral and mutual instruction of man, and improvement of his condition, seems to have been peculiarly and benevolently designed by nature, when she made them, like fire, expansible over all space, without lessening their density in any point, and like the air in which we breathe, move, and have our physical being, incapable of confinement or exclusive appropriation.―Thomas Jefferson
Letter to Isaac McPherson
August 13, 1813
To the Instructor.
The first half of this text (through Chapter M) is a course in matrix algebra, though the foundation of some more advanced ideas is also being formed in these early sections (such as Theorem NMUS, which presages invertible linear transformations). Vectors are presented exclusively as column vectors (not transposes of row vectors), and linear combinations are presented very early. Spans, null spaces, column spaces and row spaces are also presented early, simply as sets, saving most of their vector space properties for later, so they are familiar objects before being scrutinized carefully.
You cannot do everything early, so in particular matrix multiplication comes later than usual. However, with a definition built on linear combinations of column vectors, it should seem more natural than the more frequent definition using dot products of rows with columns. And this delay emphasizes that linear algebra is built upon vector addition and scalar multiplication. Of course, matrix inverses must wait for matrix multiplication, but this does not prevent nonsingular matrices from occurring sooner. Vector space properties are hinted at when vector and matrix operations are first defined, but the notion of a vector space is saved for a more axiomatic treatment later in Chapter VS. Once bases and dimension have been explored in the context of vector spaces, linear transformations and their matrix representation follow. The predominant purpose of the book is the four sections of Chapter R, which introduces the student to representations of vectors and matrices, change-of-basis, and orthonormal diagonalization (the spectral theorem). This final chapter pulls together all the important ideas of the previous chapters.
Our vector spaces use the complex numbers as the field of scalars. This avoids the fiction of complex eigenvalues being used to form scalar multiples of eigenvectors. The presence of the complex numbers in the earliest sections should not frighten students who need a review, since they will not be used heavily until much later, and Section CNO provides a quick review.
Linear algebra is an ideal subject for the novice mathematics student to learn how to develop a subject precisely, with all the rigor mathematics requires. Unfortunately, much of this rigor seems to have escaped the standard calculus curriculum, so for many university students this is their first exposure to careful definitions and theorems, and the expectation that they fully understand them, to say nothing of the expectation that they become proficient in formulating their own proofs. We have tried to make this text as helpful as possible with this transition. Every definition is stated carefully, set apart from the text. Likewise, every theorem is carefully stated, and almost every one has a complete proof. Theorems usually have just one conclusion, so they can be referenced precisely later. In the online version, we have included complete lists of every definition and theorem, in the order of their appearance, and organized by sections. These can be found in the Reference area. Along the way, there are discussions of some more important ideas relating to formulating proofs (Appendix PT), which is partly advice and partly a primer on logic.
Collecting responses to the Reading Questions prior to covering material in class will require students to learn how to read the material. Sections are designed to be covered in a fifty-minute lecture. Later sections are longer, but as students become more proficient at reading the text, it is possible to survey these longer sections at the same pace. With solutions to many of the exercises, students may be given the freedom to work homework at their own pace and style (individually, in groups, with an instructor’s help, etc.). To compensate and keep students from falling behind, I give an examination on each chapter.
Sage is a powerful open source program for advanced mathematics. It is especially robust for linear algebra. We have included an abundance of material which will help the student (and instructor) learn how to use Sage for the study of linear algebra and how to understand linear algebra better with Sage. This material is tightly integrated with the web version of the book and will become even easier to use since the technology for interfaces to Sage continues to rapidly evolve. Sage is highly capable for mathematical research as well, and so should be a tool that students can use in subsequent courses and careers. All of the Sage code has been subject to automated tests of accuracy, using the most recent version available at this time: SageMath Version 9.2 (released 2020-10-24). So you can be reasonably confident that the examples here have kept pace with the intervening improvements in Sage.
7
sagemath.orgConclusion.
Linear algebra is a beautiful subject. I have enjoyed preparing this exposition and making it widely available. Much of my motivation for writing this book is captured by the sentiments expressed by H.M. Cundy and A.P. Rollet in their Preface to the First Edition of Mathematical Models (1952), especially the final sentence,
This book was born in the classroom, and arose from the spontaneous interest of a Mathematical Sixth in the construction of simple models. A desire to show that even in mathematics one could have fun led to an exhibition of the results and attracted considerable attention throughout the school. Since then the Sherborne collection has grown, ideas have come from many sources, and widespread interest has been shown. It seems therefore desirable to give permanent form to the lessons of experience so that others can benefit by them and be encouraged to undertake similar work.
Foremost, I hope that students find their time spent with this book profitable. I hope that instructors find it flexible enough to fit the needs of their course. You can always find the latest version, and keep current with any changes, at the book’s website at linear.pugetsound.edu. I appreciate receiving suggestions, corrections, and other comments, so please do contact me.
8
linear.pugetsound.eduTacoma, Washington
December 2012
