This book presents advances in matrix and tensor data processing in the domain of signal, image and information processing. The theoretical mathematical approaches are discusses in the context of potential applications in sensor and cognitive systems engineering. The topics and application include Information Geometry, Differential Geometry of structured Matrix, Positive Definite Matrix, Covariance Matrix, Sensors (Electromagnetic Fields, Acoustic sensors) and Applications in Cognitive systems, in particular Data Mining.

This Special Issue of the journal Entropy, titled “Information Geometry I”, contains a collection of 17 papers concerning the foundations and applications of information geometry. Based on a geometrical interpretation of probability, information geometry has become a rich mathematical field employing the methods of differential geometry. It has numerous applications to data science, physics, and neuroscience. Presenting original research, yet written in an accessible, tutorial style, this collection of papers will be useful for scientists who are new to the field, while providing an excellent reference for the more experienced researcher. Several papers are written by authorities in the field, and topics cover the foundations of information geometry, as well as applications to statistics, Bayesian inference, machine learning, complex systems, physics, and neuroscience.

This book focuses on the application and development of information geometric methods in the analysis, classification and retrieval of images and signals. It provides introductory chapters to help those new to information geometry and applies the theory to several applications. This area has developed rapidly over recent years, propelled by the major theoretical developments in information geometry, efficient data and image acquisition and the desire to process and interpret large databases of digital information. The book addresses both the transfer of methodology to practitioners involved in database analysis and in its efficient computational implementation.

This book focuses on information-geometric manifolds of structured data and models and related applied mathematics. It features new and fruitful interactions between several branches of science: Advanced Signal/Image/Video Processing, Complex Data Modeling and Analysis, Statistics on Manifolds, Topology/Machine/Deep Learning and Artificial Intelligence. The selection of applications makes the book a substantial information source, not only for academic scientist but it is also highly relevant for industry. The book project was initiated following discussions at the international conference GSI’2019 – Geometric Science of Information that was held at ENAC, Toulouse (France).

This is the first comprehensive book on information geometry, written by the founder of the field. It begins with an elementary introduction to dualistic geometry and proceeds to a wide range of applications, covering information science, engineering, and neuroscience. It consists of four parts, which on the whole can be read independently. A manifold with a divergence function is first introduced, leading directly to dualistic structure, the heart of information geometry. This part (Part I) can be apprehended without any knowledge of differential geometry. An intuitive explanation of modern differential geometry then follows in Part II, although the book is for the most part understandable without modern differential geometry. Information geometry of statistical inference, including time series analysis and semiparametric estimation (the Neyman–Scott problem), is demonstrated concisely in Part III. Applications addressed in Part IV include hot current topics in machine learning, signal processing, optimization, and neural networks. The book is interdisciplinary, connecting mathematics, information sciences, physics, and neurosciences, inviting readers to a new world of information and geometry. This book is highly recommended to graduate students and researchers who seek new mathematical methods and tools useful in their own fields.

Machine learning and artificial intelligence increasingly use methodological tools rooted in statistical physics. Conversely, limitations and pitfalls encountered in AI question the very foundations of statistical physics. This interplay between AI and statistical physics has been attested since the birth of AI, and principles underpinning statistical physics can shed new light on the conceptual basis of AI. During the last fifty years, statistical physics has been investigated through new geometric structures allowing covariant formalization of the thermodynamics. Inference methods in machine learning have begun to adapt these new geometric structures to process data in more abstract representation spaces. This volume collects selected contributions on the interplay of statistical physics and artificial intelligence. The aim is to provide a constructive dialogue around a common foundation to allow the establishment of new principles and laws governing these two disciplines in a unified manner. The contributions were presented at the workshop on the Joint Structures and Common Foundation of Statistical Physics, Information Geometry and Inference for Learning which was held in Les Houches in July 2020. The various theoretical approaches are discussed in the context of potential applications in cognitive systems, machine learning, signal processing.

The book gathers contributions from the fourth conference on Information Geometry and its Applications, which was held on June 12–17, 2016, at Liblice Castle, Czech Republic on the occasion of Shun-ichi Amari’s 80th birthday and was organized by the Czech Academy of Sciences’ Institute of Information Theory and Automation. The conference received valuable financial support from the Max Planck Institute for Mathematics in the Sciences (Information Theory of Cognitive Systems Group), Czech Academy of Sciences’ Institute of Information Theory and Automation, and Università degli Studi di Roma Tor Vergata. The aim of the conference was to highlight recent advances in the field of information geometry and to identify new research directions. To this end, the event brought together leading experts in the field who, in invited talks and poster sessions, discussed both theoretical work and achievements in the many fields of application in which information geometry plays an essential role.

This book constitutes the refereed proceedings of the Second International Conference on Geometric Science of Information, GSI 2015, held in Palaiseau, France, in October 2015. The 80 full papers presented were carefully reviewed and selected from 110 submissions and are organized into the following thematic sessions: Dimension reduction on Riemannian manifolds; optimal transport; optimal transport and applications in imagery/statistics; shape space and diffeomorphic mappings; random geometry/homology; Hessian information geometry; topological forms and Information; information geometry optimization; information geometry in image analysis; divergence geometry; optimization on manifold; Lie groups and geometric mechanics/thermodynamics; computational information geometry; Lie groups: novel statistical and computational frontiers; geometry of time series and linear dynamical systems; and Bayesian and information geometry for inverse problems.

Information geometry provides the mathematical sciences with a fresh framework of analysis. This book presents a comprehensive introduction to the mathematical foundation of information geometry. It provides an overview of many areas of applications, such as statistics, linear systems, information theory, quantum mechanics, and convex analysis.

The book provides a comprehensive introduction and a novel mathematical foundation of the field of information geometry with complete proofs and detailed background material on measure theory, Riemannian geometry and Banach space theory. Parametrised measure models are defined as fundamental geometric objects, which can be both finite or infinite dimensional. Based on these models, canonical tensor fields are introduced and further studied, including the Fisher metric and the Amari-Chentsov tensor, and embeddings of statistical manifolds are investigated. This novel foundation then leads to application highlights, such as generalizations and extensions of the classical uniqueness result of Chentsov or the Cramér-Rao inequality. Additionally, several new application fields of information geometry are highlighted, for instance hierarchical and graphical models, complexity theory, population genetics, or Markov Chain Monte Carlo. The book will be of interest to mathematicians who are interested in geometry, information theory, or the foundations of statistics, to statisticians as well as to scientists interested in the mathematical foundations of complex systems.