The purpose of this book is to give a thorough introduction to the most commonly used methods of numerical linear algebra and optimisation. The prerequisites are some familiarity with the basic properties of matrices, finite-dimensional vector spaces, advanced calculus, and some elementary notations from functional analysis. The book is in two parts. The first deals with numerical linear algebra (review of matrix theory, direct and iterative methods for solving linear systems, calculation of eigenvalues and eigenvectors) and the second, optimisation (general algorithms, linear and nonlinear programming). The author has based the book on courses taught for advanced undergraduate and beginning graduate students and the result is a well-organised and lucid exposition. Summaries of basic mathematics are provided, proofs of theorems are complete yet kept as simple as possible, and applications from physics and mechanics are discussed. Professor Ciarlet has also helpfully provided over 40 line diagrams, a great many applications, and a useful guide to further reading. This excellent textbook, which is translated and revised from the very successful French edition, will be of great value to students of numerical analysis, applied mathematics and engineering.

A concise, insightful, and elegant introduction to the field of numerical linear algebra. Designed for use as a stand-alone textbook in a one-semester, graduate-level course in the topic, it has already been class-tested by MIT and Cornell graduate students from all fields of mathematics, engineering, and the physical sciences. The authors' clear, inviting style and evident love of the field, along with their eloquent presentation of the most fundamental ideas in numerical linear algebra, make it popular with teachers and students alike.

Full of features and applications, this acclaimed textbook for upper undergraduate level and graduate level students includes all the major topics of computational linear algebra, including solution of a system of linear equations, least-squares solutions of linear systems, computation of eigenvalues, eigenvectors, and singular value problems. Drawing from numerous disciplines of science and engineering, the author covers a variety of motivating applications. When a physical problem is posed, the scientific and engineering significance of the solution is clearly stated. Each chapter contains a summary of the important concepts developed in that chapter, suggestions for further reading, and numerous exercises, both theoretical and MATLAB and MATCOM based. The author also provides a list of key words for quick reference. The MATLAB toolkit available online, 'MATCOM', contains implementations of the major algorithms in the book and will enable students to study different algorithms for the same problem, comparing efficiency, stability, and accuracy.

This book combines a solid theoretical background in linear algebra with practical algorithms for numerical solution of linear algebra problems. Developed from a number of courses taught repeatedly by the authors, the material covers topics like matrix algebra, theory for linear systems of equations, spectral theory, vector and matrix norms combined with main direct and iterative numerical methods, least squares problems, and eigenproblems. Numerical algorithms illustrated by computer programs written in MATLAB® are also provided as supplementary material on SpringerLink to give the reader a better understanding of professional numerical software for the solution of real-life problems. Perfect for a one- or two-semester course on numerical linear algebra, matrix computation, and large sparse matrices, this text will interest students at the advanced undergraduate or graduate level.

This book introduces numerical issues that arise in linear algebra and its applications. It touches on a wide range of techniques, including direct and iterative methods, orthogonal factorizations, least squares, eigenproblems, and nonlinear equations. Detailed explanations on a wide range of topics from condition numbers to singular value decomposition are provided, as well as material on nonlinear and linear systems. Numerical examples, often based on discretizations of boundary-value problems, are used to illustrate concepts. Exercises with detailed solutions are provided at the end of the book, and supplementary material and updates are available online. This Classics edition is appropriate for junior and senior undergraduate students and beginning graduate students in courses such as advanced numerical analysis, special topics on numerical analysis, topics on data science, topics on numerical optimization, and topics on approximation theory.

This textbook introduces linear algebra and optimization in the context of machine learning. Examples and exercises are provided throughout the book. A solution manual for the exercises at the end of each chapter is available to teaching instructors. This textbook targets graduate level students and professors in computer science, mathematics and data science. Advanced undergraduate students can also use this textbook. The chapters for this textbook are organized as follows: 1. Linear algebra and its applications: The chapters focus on the basics of linear algebra together with their common applications to singular value decomposition, matrix factorization, similarity matrices (kernel methods), and graph analysis. Numerous machine learning applications have been used as examples, such as spectral clustering, kernel-based classification, and outlier detection. The tight integration of linear algebra methods with examples from machine learning differentiates this book from generic volumes on linear algebra. The focus is clearly on the most relevant aspects of linear algebra for machine learning and to teach readers how to apply these concepts. 2. Optimization and its applications: Much of machine learning is posed as an optimization problem in which we try to maximize the accuracy of regression and classification models. The “parent problem” of optimization-centric machine learning is least-squares regression. Interestingly, this problem arises in both linear algebra and optimization, and is one of the key connecting problems of the two fields. Least-squares regression is also the starting point for support vector machines, logistic regression, and recommender systems. Furthermore, the methods for dimensionality reduction and matrix factorization also require the development of optimization methods. A general view of optimization in computational graphs is discussed together with its applications to back propagation in neural networks. A frequent challenge faced by beginners in machine learning is the extensive background required in linear algebra and optimization. One problem is that the existing linear algebra and optimization courses are not specific to machine learning; therefore, one would typically have to complete more course material than is necessary to pick up machine learning. Furthermore, certain types of ideas and tricks from optimization and linear algebra recur more frequently in machine learning than other application-centric settings. Therefore, there is significant value in developing a view of linear algebra and optimization that is better suited to the specific perspective of machine learning.

Revised and updated, the third edition of Golub and Van Loan's classic text in computer science provides essential information about the mathematical background and algorithmic skills required for the production of numerical software. This new edition includes thoroughly revised chapters on matrix multiplication problems and parallel matrix computations, expanded treatment of CS decomposition, an updated overview of floating point arithmetic, a more accurate rendition of the modified Gram-Schmidt process, and new material devoted to GMRES, QMR, and other methods designed to handle the sparse unsymmetric linear system problem.

'The numerical algorithms presented are written in pseudocode and based on MATLAB, a programming and numeric computing platform widely used in STEM fields. Thus, no formal training in computer science or knowledge of any specific programming language is needed to parse the algorithms. Summing up: Recommended.'CHOICEMany students come to numerical linear algebra from science and engineering seeking modern tools and an understanding of how the tools work and their limitations. Often their backgrounds and experience are extensive in applications of numerical methods but limited in abstract mathematics and matrix theory. Often enough it is limited to multivariable calculus, basic differential equations and methods of applied mathematics. This book introduces modern tools of numerical linear algebra based on this background, heavy in applied analysis but light in matrix canonical forms and their algebraic properties. Each topic is presented as algorithmic ideas and through a foundation based on mostly applied analysis. By picking a path through the book appropriate for the level, it has been used for both senior level undergraduates and beginning graduate classes with students from diverse fields and backgrounds.

This expansive volume describes the history of numerical methods proposed for solving linear algebra problems, from antiquity to the present day. The authors focus on methods for linear systems of equations and eigenvalue problems and describe the interplay between numerical methods and the computing tools available at the time. The second part of the book consists of 78 biographies of important contributors to the field. A Journey through the History of Numerical Linear Algebra will be of special interest to applied mathematicians, especially researchers in numerical linear algebra, people involved in scientific computing, and historians of mathematics.

Algorithms are a dominant force in modern culture, and every indication is that they will become more pervasive, not less. The best algorithms are undergirded by beautiful mathematics. This text cuts across discipline boundaries to highlight some of the most famous and successful algorithms. Readers are exposed to the principles behind these examples and guided in assembling complex algorithms from simpler building blocks. Written in clear, instructive language within the constraints of mathematical rigor, Algorithms from THE BOOK includes a large number of classroom-tested exercises at the end of each chapter. The appendices cover background material often omitted from undergraduate courses. Most of the algorithm descriptions are accompanied by Julia code, an ideal language for scientific computing. This code is immediately available for experimentation. Algorithms from THE BOOK is aimed at first-year graduate and advanced undergraduate students. It will also serve as a convenient reference for professionals throughout the mathematical sciences, physical sciences, engineering, and the quantitative sectors of the biological and social sciences.