This book studies mathematical theories of machine learning. The first part of the book explores the optimality and adaptivity of choosing step sizes of gradient descent for escaping strict saddle points in non-convex optimization problems. In the second part, the authors propose algorithms to find local minima in nonconvex optimization and to obtain global minima in some degree from the Newton Second Law without friction. In the third part, the authors study the problem of subspace clustering with noisy and missing data, which is a problem well-motivated by practical applications data subject to stochastic Gaussian noise and/or incomplete data with uniformly missing entries. In the last part, the authors introduce an novel VAR model with Elastic-Net regularization and its equivalent Bayesian model allowing for both a stable sparsity and a group selection. Provides a thorough look into the variety of mathematical theories of machine learning Presented in four parts, allowing for readers to easily navigate the complex theories Includes extensive empirical studies on both the synthetic and real application time series data.

This book studies mathematical theories of machine learning. The first part of the book explores the optimality and adaptivity of choosing step sizes of gradient descent for escaping strict saddle points in non-convex optimization problems. In the second part, the authors propose algorithms to find local minima in nonconvex optimization and to obtain global minima in some degree from the Newton Second Law without friction. In the third part, the authors study the problem of subspace clustering with noisy and missing data, which is a problem well-motivated by practical applications data subject to stochastic Gaussian noise and/or incomplete data with uniformly missing entries. In the last part, the authors introduce an novel VAR model with Elastic-Net regularization and its equivalent Bayesian model allowing for both a stable sparsity and a group selection.

The book reviews core concepts of machine learning (ML) while focusing on modern applications. It is aimed at those who want to advance their understanding of ML by providing technical and practical insights. It does not use complicated mathematics to explain how to benefit from ML algorithms. Unlike the existing literature, this work provides the core concepts with emphasis on fresh ideas and real application scenarios. It starts with the basic concepts of ML and extends the concepts to the different deep learning algorithms. The book provides an introduction and main elements of evaluation tools with Python and walks you through the recent applications of ML in self-driving cars, cognitive decision making, communication networks, security, and signal processing. The concept of generative networks is also presented and focuses on GANs as a tool to improve the performance of existing algorithms. In summary, this book provides a comprehensive technological path from fundamental theories to the categorization of existing algorithms, covers state-of-the-art, practical evaluation tools and methods to empower you to use synthetic data to improve the performance of applications.

Machine Learning Theory and Applications Enables readers to understand mathematical concepts behind data engineering and machine learning algorithms and apply them using open-source Python libraries Machine Learning Theory and Applications delves into the realm of machine learning and deep learning, exploring their practical applications by comprehending mathematical concepts and implementing them in real-world scenarios using Python and renowned open-source libraries. This comprehensive guide covers a wide range of topics, including data preparation, feature engineering techniques, commonly utilized machine learning algorithms like support vector machines and neural networks, as well as generative AI and foundation models. To facilitate the creation of machine learning pipelines, a dedicated open-source framework named hephAIstos has been developed exclusively for this book. Moreover, the text explores the fascinating domain of quantum machine learning and offers insights on executing machine learning applications across diverse hardware technologies such as CPUs, GPUs, and QPUs. Finally, the book explains how to deploy trained models through containerized applications using Kubernetes and OpenShift, as well as their integration through machine learning operations (MLOps). Additional topics covered in Machine Learning Theory and Applications include: Current use cases of AI, including making predictions, recognizing images and speech, performing medical diagnoses, creating intelligent supply chains, natural language processing, and much more Classical and quantum machine learning algorithms such as quantum-enhanced Support Vector Machines (QSVMs), QSVM multiclass classification, quantum neural networks, and quantum generative adversarial networks (qGANs) Different ways to manipulate data, such as handling missing data, analyzing categorical data, or processing time-related data Feature rescaling, extraction, and selection, and how to put your trained models to life and production through containerized applications Machine Learning Theory and Applications is an essential resource for data scientists, engineers, and IT specialists and architects, as well as students in computer science, mathematics, and bioinformatics. The reader is expected to understand basic Python programming and libraries such as NumPy or Pandas and basic mathematical concepts, especially linear algebra.

This volume includes some of the key research papers in the area of machine learning produced at MIT and Siemens during a three-year joint research effort. It includes papers on many different styles of machine learning, organized into three parts. Part I, theory, includes three papers on theoretical aspects of machine learning. The first two use the theory of computational complexity to derive some fundamental limits on what isefficiently learnable. The third provides an efficient algorithm for identifying finite automata. Part II, artificial intelligence and symbolic learning methods, includes five papers giving an overview of the state of the art and future developments in the field of machine learning, a subfield of artificial intelligence dealing with automated knowledge acquisition and knowledge revision. Part III, neural and collective computation, includes five papers sampling the theoretical diversity and trends in the vigorous new research field of neural networks: massively parallel symbolic induction, task decomposition through competition, phoneme discrimination, behavior-based learning, and self-repairing neural networks.

Machine learning is currently one of the most rapidly growing areas of research in computer science. In compiling this volume we have brought together contributions from some of the most prestigious researchers in this field. This book covers the three main learning systems; symbolic learning, neural networks and genetic algorithms as well as providing a tutorial on learning casual influences. Each of the nine chapters is self-contained. Both theoreticians and application scientists/engineers in the broad area of artificial intelligence will find this volume valuable. It also provides a useful sourcebook for Postgraduate since it shows the direction of current research.

Trained to extract actionable information from large volumes of high-dimensional data, engineers and scientists often have trouble isolating meaningful low-dimensional structures hidden in their high-dimensional observations. Manifold learning, a groundbreaking technique designed to tackle these issues of dimensionality reduction, finds widespread application in machine learning, neural networks, pattern recognition, image processing, and computer vision. Filling a void in the literature, Manifold Learning Theory and Applications incorporates state-of-the-art techniques in manifold learning with a solid theoretical and practical treatment of the subject. Comprehensive in its coverage, this pioneering work explores this novel modality from algorithm creation to successful implementation—offering examples of applications in medical, biometrics, multimedia, and computer vision. Emphasizing implementation, it highlights the various permutations of manifold learning in industry including manifold optimization, large scale manifold learning, semidefinite programming for embedding, manifold models for signal acquisition, compression and processing, and multi scale manifold. Beginning with an introduction to manifold learning theories and applications, the book includes discussions on the relevance to nonlinear dimensionality reduction, clustering, graph-based subspace learning, spectral learning and embedding, extensions, and multi-manifold modeling. It synergizes cross-domain knowledge for interdisciplinary instructions, offers a rich set of specialized topics contributed by expert professionals and researchers from a variety of fields. Finally, the book discusses specific algorithms and methodologies using case studies to apply manifold learning for real-world problems.

This edited book is a collection of chapters invited and presented by experts at 10th industry symposium held during 9–12 January 2020 in conjunction with 16th edition of ICDCIT. The book covers topics, like machine learning and its applications, statistical learning, neural network learning, knowledge acquisition and learning, knowledge intensive learning, machine learning and information retrieval, machine learning for web navigation and mining, learning through mobile data mining, text and multimedia mining through machine learning, distributed and parallel learning algorithms and applications, feature extraction and classification, theories and models for plausible reasoning, computational learning theory, cognitive modelling and hybrid learning algorithms.

This book is a collection of the most recent approaches that combine metaheuristics and machine learning. Some of the methods considered in this book are evolutionary, swarm, machine learning, and deep learning. The chapters were classified based on the content; then, the sections are thematic. Different applications and implementations are included; in this sense, the book provides theory and practical content with novel machine learning and metaheuristic algorithms. The chapters were compiled using a scientific perspective. Accordingly, the book is primarily intended for undergraduate and postgraduate students of Science, Engineering, and Computational Mathematics and is useful in courses on Artificial Intelligence, Advanced Machine Learning, among others. Likewise, the book is useful for research from the evolutionary computation, artificial intelligence, and image processing communities.

Welcome to a journey through the fascinating world of decision-making, where mathematics and technology converge to illuminate the path forward. This book, "Mathematical Theories in Strategic Decisions," is your guide to the mathematical underpinnings of decision-making processes that shape our lives, from business strategies that drive economies to healthcare decisions that impact our well-being. In the pages that follow, you'll embark on a quest to unravel the mysteries of mathematical theories and witness their transformative power in action. Each chapter is a portal into a different dimension of decision intelligence, offering you a front-row seat to the intricate dance of numbers, algorithms, and real-world applications. From the classical elegance of Game Theory to the probabilistic precision of Bayesian Statistics, from the structured clarity of Decision Trees to the computational marvel of Monte Carlo Simulation, and finally, to the cutting-edge frontiers of Artificial Intelligence and Machine Learning, you'll explore the full spectrum of mathematical tools that empower decision-makers to navigate complexity and uncertainty. Through immersive case studies, practical examples, and human-like narrative, you'll meet professionals like Dr. Sarah, Emily, and Dr. Mia who harness the power of mathematics to make decisions that matter. You'll witness how mathematical theories optimize business strategies, streamline operations, diagnose diseases, manage risks, and revolutionize healthcare. But this journey is not merely about the mechanics of mathematics; it's about the profound impact it has on our world. It's about enabling us to make better decisions, to allocate resources efficiently, to mitigate risks, and to unlock the doors of innovation and discovery. It's about illuminating the dark corners of uncertainty and guiding us toward informed choices. As you turn the pages of this book, may you find inspiration in the elegance of mathematical theories and the ingenuity of human minds. May you discover that in the intricate dance of numbers, we find the compass to navigate the intricate landscape of decisions.