This book provides a self-contained and accessible introduction to linear and multilinear algebra. Besides the standard techniques for linear and multilinear algebra many advanced topics are included. Emphasis is placed on the Kronecker product and tensor product. The Kronecker product has widespread applications in signal processing, discrete wavelets, statistical physics, computer graphics, fractals, quantum mechanics and quantum computing. All these fields are covered in detail. A key feature of the book is the many detailed worked-out examples. Computer algebra applications are also given. Each chapter includes useful exercises. The book is well suited for pure and applied mathematicians as well as theoretical physicists and engineers.New topics added to the second edition are: braid-like relations, Clebsch-Gordan expansion, nearest Kronecker product, Clifford and Pauli group, universal enveloping algebra, computer algebra and Kronecker product.

Our self-contained volume provides an accessible introduction to linear and multilinear algebra as well as tensor calculus. Besides the standard techniques for linear algebra, multilinear algebra and tensor calculus, many advanced topics are included where emphasis is placed on the Kronecker product and tensor product. The Kronecker product has widespread applications in signal processing, discrete wavelets, statistical physics, Hopf algebra, Yang-Baxter relations, computer graphics, fractals, quantum mechanics, quantum computing, entanglement, teleportation and partial trace. All these fields are covered comprehensively.The volume contains many detailed worked-out examples. Each chapter includes useful exercises and supplementary problems. In the last chapter, software implementations are provided for different concepts. The volume is well suited for pure and applied mathematicians as well as theoretical physicists and engineers.New topics added to the third edition are: mutually unbiased bases, Cayley transform, spectral theorem, nonnormal matrices, Gâteaux derivatives and matrices, trace and partial trace, spin coherent states, Clebsch-Gordan series, entanglement, hyperdeterminant, tensor eigenvalue problem, Carleman matrix and Bell matrix, tensor fields and Ricci tensors, and software implementations.

Kronecker products are used to define the underlying Markov chain (MC) in various modeling formalisms, including compositional Markovian models, hierarchical Markovian models, and stochastic process algebras. The motivation behind using a Kronecker structured representation rather than a flat one is to alleviate the storage requirements associated with the MC. With this approach, systems that are an order of magnitude larger can be analyzed on the same platform. The developments in the solution of such MCs are reviewed from an algebraic point of view and possible areas for further research are indicated with an emphasis on preprocessing using reordering, grouping, and lumping and numerical analysis using block iterative, preconditioned projection, multilevel, decompositional, and matrix analytic methods. Case studies from closed queueing networks and stochastic chemical kinetics are provided to motivate decompositional and matrix analytic methods, respectively.

This revised edition provides the mathematical background and algorithmic skills required for the production of numerical software. It includes rewritten and clarified proofs and derivations, as well as new topics such as Arnoldi iteration, and domain decomposition methods.

Representations are at the heart of artificial intelligence (AI). This book is devoted to the problem of representation discovery: how can an intelligent system construct representations from its experience? Representation discovery re-parameterizes the state space - prior to the application of information retrieval, machine learning, or optimization techniques - facilitating later inference processes by constructing new task-specific bases adapted to the state space geometry. This book presents a general approach to representation discovery using the framework of harmonic analysis, in particular Fourier and wavelet analysis. Biometric compression methods, the compact disc, the computerized axial tomography (CAT) scanner in medicine, JPEG compression, and spectral analysis of time-series data are among the many applications of classical Fourier and wavelet analysis. A central goal of this book is to show that these analytical tools can be generalized from their usual setting in (infinite-dimensional) Euclidean spaces to discrete (finite-dimensional) spaces typically studied in many subfields of AI. Generalizing harmonic analysis to discrete spaces poses many challenges: a discrete representation of the space must be adaptively acquired; basis functions are not pre-defined, but rather must be constructed. Algorithms for efficiently computing and representing bases require dealing with the curse of dimensionality. However, the benefits can outweigh the costs, since the extracted basis functions outperform parametric bases as they often reflect the irregular shape of a particular state space. Case studies from computer graphics, information retrieval, machine learning, and state space planning are used to illustrate the benefits of the proposed framework, and the challenges that remain to be addressed. Representation discovery is an actively developing field, and the author hopes this book will encourage other researchers to explore this exciting area of research. Table of Contents: Overview / Vector Spaces / Fourier Bases on Graphs / Multiscale Bases on Graphs / Scaling to Large Spaces / Case Study: State-Space Planning / Case Study: Computer Graphics / Case Study: Natural Language / Future Directions

Compared to other books devoted to matrices, this volume is unique in covering the whole of a triptych consisting of algebraic theory, algorithmic problems and numerical applications, all united by the essential use and urge for development of matrix methods. This was the spirit of the 2nd International Conference on Matrix Methods and Operator Equations from 23-27 July 2007 in Moscow that was organized by Dario Bini, Gene Golub, Alexander Guterman, Vadim Olshevsky, Stefano Serra-Capizzano, Gilbert Strang and Eugene Tyrtyshnikov.Matrix methods provide the key to many problems in pure and applied mathematics. However, linear algebra theory, numerical algorithms and matrices in FEM/BEM applications usually live as if in three separate worlds. In this volume, maybe for the first time ever, they are compiled together as one entity as it was at the Moscow meeting, where the algebraic part was impersonated by Hans Schneider, algorithms by Gene Golub, and applications by Guri Marchuk. All topics intervened in plenary sessions are specially categorized into three sections of this volume.The soul of the meeting was Gene Golub, who rendered a charming “Golub's dimension” to the three main axes of the conference topics. This volume is dedicated in gratitude to his memory.

This book constitutes the proceedings of the 10th International Conference on Latent Variable Analysis and Signal Separation, LVA/ICA 2012, held in Tel Aviv, Israel, in March 2012. The 20 revised full papers presented together with 42 revised poster papers, 1 keynote lecture, and 2 overview papers for the regular, as well as for the special session were carefully reviewed and selected from numerous submissions. Topics addressed are ranging from theoretical issues such as causality analysis and measures, through novel methods for employing the well-established concepts of sparsity and non-negativity for matrix and tensor factorization, down to a variety of related applications ranging from audio and biomedical signals to precipitation analysis.

The most difficult computational problems nowadays are those of higher dimensions. This research monograph offers an introduction to tensor numerical methods designed for the solution of the multidimensional problems in scientific computing. These methods are based on the rank-structured approximation of multivariate functions and operators by using the appropriate tensor formats. The old and new rank-structured tensor formats are investigated. We discuss in detail the novel quantized tensor approximation method (QTT) which provides function-operator calculus in higher dimensions in logarithmic complexity rendering super-fast convolution, FFT and wavelet transforms. This book suggests the constructive recipes and computational schemes for a number of real life problems described by the multidimensional partial differential equations. We present the theory and algorithms for the sinc-based separable approximation of the analytic radial basis functions including Green’s and Helmholtz kernels. The efficient tensor-based techniques for computational problems in electronic structure calculations and for the grid-based evaluation of long-range interaction potentials in multi-particle systems are considered. We also discuss the QTT numerical approach in many-particle dynamics, tensor techniques for stochastic/parametric PDEs as well as for the solution and homogenization of the elliptic equations with highly-oscillating coefficients. Contents Theory on separable approximation of multivariate functions Multilinear algebra and nonlinear tensor approximation Superfast computations via quantized tensor approximation Tensor approach to multidimensional integrodifferential equations

This book reviews research developments in diverse areas of reinforcement learning such as model-free actor-critic methods, model-based learning and control, information geometry of policy searches, reward design, and exploration in biology and the behavioral sciences. Special emphasis is placed on advanced ideas, algorithms, methods, and applications. The contributed papers gathered here grew out of a lecture course on reinforcement learning held by Prof. Jan Peters in the winter semester 2018/2019 at Technische Universität Darmstadt. The book is intended for reinforcement learning students and researchers with a firm grasp of linear algebra, statistics, and optimization. Nevertheless, all key concepts are introduced in each chapter, making the content self-contained and accessible to a broader audience.