In recent decades, Reinforcement Learning (RL) has emerged as an effective approach to address complex control tasks. In a Markov Decision Process (MDP), the framework typically used, the environment is assumed to be a fixed entity that cannot be altered externally. There are, however, several real-world scenarios in which the environment can be modified to a limited extent. This book, Exploiting Environment Configurability in Reinforcement Learning, aims to formalize and study diverse aspects of environment configuration. In a traditional MDP, the agent perceives the state of the environment and performs actions. As a consequence, the environment transitions to a new state and generates a reward signal. The goal of the agent consists of learning a policy, i.e., a prescription of actions that maximize the long-term reward. Although environment configuration arises quite often in real applications, the topic is very little explored in the literature. The contributions in the book are theoretical, algorithmic, and experimental and can be broadly subdivided into three parts. The first part introduces the novel formalism of Configurable Markov Decision Processes (Conf-MDPs) to model the configuration opportunities offered by the environment. The second part of the book focuses on the cooperative Conf-MDP setting and investigates the problem of finding an agent policy and an environment configuration that jointly optimize the long-term reward. The third part addresses two specific applications of the Conf-MDP framework: policy space identification and control frequency adaptation. The book will be of interest to all those using RL as part of their work.

Artificial intelligence (AI) has been much in the news recently, with some commentators expressing concern that AI might eventually replace humans. But many developments in AI are designed to enhance and supplement the performance of humans rather than replace them, and a novel field of study, with new approaches and solutions to the development of AI, has arisen to focus on this aspect of the technology. This book presents the proceedings of HHAI2023, the 2nd International Conference on Hybrid Human-Artificial Intelligence, held from 26-30 June 2023, in Munich, Germany. The HHAI international conference series is focused on the study of artificially intelligent systems that cooperate synergistically, proactively, responsibly and purposefully with humans, amplifying rather than replacing human intelligence, and invites contributions from various fields, including AI, human-computer interaction, the cognitive and social sciences, computer science, philosophy, among others. A total of 78 submissions were received for the main conference track, and most papers were reviewed by at least three reviewers. The overall final acceptance rate was 43%, with 14 contributions accepted as full papers, 14 as working papers, and 6 as extended abstracts. The papers presented here cover topics including interactive hybrid agents; hybrid intelligence for decision support; hybrid intelligence for health; and values such as fairness and trust in hybrid intelligence. We further accepted 17 posters and 4 demos as well as 8 students to the first HHAI doctoral consortium this year. The authors of 4 working papers and 2 doctoral consortium submissions opted for not publishing their submissions to allow a later full submission, resulting in a total of 57 papers included in this proceedings Addressing all aspects of AI systems that assist humans and emphasizing the need for adaptive, collaborative, responsible, interactive, and human-centered artificial intelligence systems which can leverage human strengths and compensate for human weaknesses while considering social, ethical, and legal considerations, the book will be of interest to all those working in the field.

The digital era has brought about important changes that continue to affect all our lives. Efficient management and storage of digital information has become crucial, as has the ability to access that information quickly and efficiently, and priorities are to allow for the saving of digital data in many different ways, and to avoid the loss of information in the event of a malfunction. This book presents the 65 papers presented at DMI2022, the first in the new annual conference series Digitalization and Management Innovation (DMI), held as a hybrid event in Beijing, China, on 26 November 2022. A total of 190 submissions were received for the conference, and the papers presented here were selected after careful and conscientious review, bearing in mind the breadth and depth of the research topics falling within the scope of digital and management innovation and resulting in an acceptance rate of 34%. Topics covered include digital transformation, supply chains, business models, and block chain, enterprises, banking, and sustainability, as well as policy in artificial intelligence, the gig economy, the post-epidemic era, green supply, citizenship behavior, human resource management, human relationships, agriculture, and environmental matters. Presenting original ideas and results of general significance and supported by clear reasoning, and compelling evidence and methods, the book will be of interest to all those whose work involves the management of digital data.

If only it were possible to develop automated and trainable neural systems that could justify their behavior in a way that could be interpreted by humans like a symbolic system. The field of Neurosymbolic AI aims to combine two disparate approaches to AI; symbolic reasoning and neural or connectionist approaches such as Deep Learning. The quest to unite these two types of AI has led to the development of many innovative techniques which extend the boundaries of both disciplines. This book, Compendium of Neurosymbolic Artificial Intelligence, presents 30 invited papers which explore various approaches to defining and developing a successful system to combine these two methods. Each strategy has clear advantages and disadvantages, with the aim of most being to find some useful middle ground between the rigid transparency of symbolic systems and the more flexible yet highly opaque neural applications. The papers are organized by theme, with the first four being overviews or surveys of the field. These are followed by papers covering neurosymbolic reasoning; neurosymbolic architectures; various aspects of Deep Learning; and finally two chapters on natural language processing. All papers were reviewed internally before publication. The book is intended to follow and extend the work of the previous book, Neuro-symbolic artificial intelligence: The state of the art (IOS Press; 2021) which laid out the breadth of the field at that time. Neurosymbolic AI is a young field which is still being actively defined and explored, and this book will be of interest to those working in AI research and development.

Machine learning is a potential solution to resolve bottleneck issues in VLSI via optimizing tasks in the design process. This book aims to provide the latest machine-learning–based methods, algorithms, architectures, and frameworks designed for VLSI design. The focus is on digital, analog, and mixed-signal design techniques, device modeling, physical design, hardware implementation, testability, reconfigurable design, synthesis and verification, and related areas. Chapters include case studies as well as novel research ideas in the given field. Overall, the book provides practical implementations of VLSI design, IC design, and hardware realization using machine learning techniques. Features: Provides the details of state-of-the-art machine learning methods used in VLSI design Discusses hardware implementation and device modeling pertaining to machine learning algorithms Explores machine learning for various VLSI architectures and reconfigurable computing Illustrates the latest techniques for device size and feature optimization Highlights the latest case studies and reviews of the methods used for hardware implementation This book is aimed at researchers, professionals, and graduate students in VLSI, machine learning, electrical and electronic engineering, computer engineering, and hardware systems.

Build real-world artificial intelligence apps on AWS to overcome challenges faced by healthcare providers and payers, as well as pharmaceutical, life sciences research, and commercial organizations Key FeaturesLearn about healthcare industry challenges and how machine learning can solve themExplore AWS machine learning services and their applications in healthcare and life sciencesDiscover practical coding instructions to implement machine learning for healthcare and life sciencesBook Description While machine learning is not new, it's only now that we are beginning to uncover its true potential in the healthcare and life sciences industry. The availability of real-world datasets and access to better compute resources have helped researchers invent applications that utilize known AI techniques in every segment of this industry, such as providers, payers, drug discovery, and genomics. This book starts by summarizing the introductory concepts of machine learning and AWS machine learning services. You'll then go through chapters dedicated to each segment of the healthcare and life sciences industry. Each of these chapters has three key purposes -- First, to introduce each segment of the industry, its challenges, and the applications of machine learning relevant to that segment. Second, to help you get to grips with the features of the services available in the AWS machine learning stack like Amazon SageMaker and Amazon Comprehend Medical. Third, to enable you to apply your new skills to create an ML-driven solution to solve problems particular to that segment. The concluding chapters outline future industry trends and applications. By the end of this book, you'll be aware of key challenges faced in applying AI to healthcare and life sciences industry and learn how to address those challenges with confidence. What you will learnExplore the healthcare and life sciences industryFind out about the key applications of AI in different industry segmentsApply AI to medical images, clinical notes, and patient dataDiscover security, privacy, fairness, and explainability best practicesExplore the AWS ML stack and key AI services for the industryDevelop practical ML skills using code and AWS servicesDiscover all about industry regulatory requirementsWho this book is for This book is specifically tailored toward technology decision-makers, data scientists, machine learning engineers, and anyone who works in the data engineering role in healthcare and life sciences organizations. Whether you want to apply machine learning to overcome common challenges in the healthcare and life science industry or are looking to understand the broader industry AI trends and landscape, this book is for you. This book is filled with hands-on examples for you to try as you learn about new AWS AI concepts.

This book covers a variety of advanced communications technologies that can be used to analyze medical data and can be used to diagnose diseases in clinic centers. The book is a primer of methods for medicine, providing an overview of explainable artificial intelligence (AI) techniques that can be applied in different medical challenges. The authors discuss how to select and apply the proper technology depending on the provided data and the analysis desired. Because a variety of data can be used in the medical field, the book explains how to deal with challenges connected with each type. A number of scenarios are introduced that can happen in real-time environments, with each pared with a type of machine learning that can be used to solve it.

Master Machine Learning Fundamentals Whether you’re an aspiring data scientist, business professional, or curious learner, Machine Learning Fundamentals in Action is your essential guide to the world of machine learning. Packed with practical examples and real-world applications, this book helps you navigate key concepts and techniques transforming industries today. Unlock the Power of Machine Learning Discover every step, from data preparation to building and deploying models, with clear and actionable insights. Who Is This Book For? Aspiring Data Scientists: Build a solid foundation in ML concepts. Business Professionals: Use data-driven decisions to solve challenges. Developers and Engineers: Get hands-on experience with model-building techniques. Curious Learners: Understand ML with easy, step-by-step explanations. What You’ll Learn: Core ML principles and real-world applications Types of ML: Supervised, Unsupervised, and Reinforcement Learning Advanced topics: Neural networks, deep learning, and more How to deploy models and avoid common pitfalls Start your machine learning journey today!

The most common document formalisation for text classi?cation is the vector space model founded on the bag of words/phrases representation. The main advantage of the vector space model is that it can readily be employed by classi?cation - gorithms. However, the bag of words/phrases representation is suited to capturing only word/phrase frequency; structural and semantic information is ignored. It has been established that structural information plays an important role in classi?cation accuracy [14]. An alternative to the bag of words/phrases representation is a graph based rep- sentation, which intuitively possesses much more expressive power. However, this representation introduces an additional level of complexity in that the calculation of the similarity between two graphs is signi?cantly more computationally expensive than between two vectors (see for example [16]). Some work (see for example [12]) has been done on hybrid representations to capture both structural elements (- ing the graph model) and signi?cant features using the vector model. However the computational resources required to process this hybrid model are still extensive.

This open access book presents thirteen outstanding doctoral dissertations in Information Technology from the Department of Electronics, Information and Bioengineering, Politecnico di Milano, Italy. Information Technology has always been highly interdisciplinary, as many aspects have to be considered in IT systems. The doctoral studies program in IT at Politecnico di Milano emphasizes this interdisciplinary nature, which is becoming more and more important in recent technological advances, in collaborative projects, and in the education of young researchers. Accordingly, the focus of advanced research is on pursuing a rigorous approach to specific research topics starting from a broad background in various areas of Information Technology, especially Computer Science and Engineering, Electronics, Systems and Control, and Telecommunications. Each year, more than 50 PhDs graduate from the program. This book gathers the outcomes of the thirteen best theses defended in 2020-21 and selected for the IT PhD Award. Each of the authors provides a chapter summarizing his/her findings, including an introduction, description of methods, main achievements and future work on the topic. Hence, the book provides a cutting-edge overview of the latest research trends in Information Technology at Politecnico di Milano, presented in an easy-to-read format that will also appeal to non-specialists.