Model-Based Approaches to Learning provides a new perspective called learning by system modeling. This book explores the learning impact of students when constructing models of complex systems.

Deep reinforcement learning has attracted considerable attention recently. Impressive results have been achieved in such diverse fields as autonomous driving, game playing, molecular recombination, and robotics. In all these fields, computer programs have taught themselves to understand problems that were previously considered to be very difficult. In the game of Go, the program AlphaGo has even learned to outmatch three of the world’s leading players.Deep reinforcement learning takes its inspiration from the fields of biology and psychology. Biology has inspired the creation of artificial neural networks and deep learning, while psychology studies how animals and humans learn, and how subjects’ desired behavior can be reinforced with positive and negative stimuli. When we see how reinforcement learning teaches a simulated robot to walk, we are reminded of how children learn, through playful exploration. Techniques that are inspired by biology and psychology work amazingly well in computers: animal behavior and the structure of the brain as new blueprints for science and engineering. In fact, computers truly seem to possess aspects of human behavior; as such, this field goes to the heart of the dream of artificial intelligence. These research advances have not gone unnoticed by educators. Many universities have begun offering courses on the subject of deep reinforcement learning. The aim of this book is to provide an overview of the field, at the proper level of detail for a graduate course in artificial intelligence. It covers the complete field, from the basic algorithms of Deep Q-learning, to advanced topics such as multi-agent reinforcement learning and meta learning.

In this book, we have set up a unified analytical framework for various human-robot systems, which involve peer-peer interactions (either space-sharing or time-sharing) or hierarchical interactions. A methodology in designing the robot behavior through control, planning, decision and learning is proposed. In particular, the following topics are discussed in-depth: safety during human-robot interactions, efficiency in real-time robot motion planning, imitation of human behaviors from demonstration, dexterity of robots to adapt to different environments and tasks, cooperation among robots and humans with conflict resolution. These methods are applied in various scenarios, such as human-robot collaborative assembly, robot skill learning from human demonstration, interaction between autonomous and human-driven vehicles, etc. Key Features: Proposes a unified framework to model and analyze human-robot interactions under different modes of interactions. Systematically discusses the control, decision and learning algorithms to enable robots to interact safely with humans in a variety of applications. Presents numerous experimental studies with both industrial collaborative robot arms and autonomous vehicles.

How can machine learning help the design of future communication networks – and how can future networks meet the demands of emerging machine learning applications? Discover the interactions between two of the most transformative and impactful technologies of our age in this comprehensive book. First, learn how modern machine learning techniques, such as deep neural networks, can transform how we design and optimize future communication networks. Accessible introductions to concepts and tools are accompanied by numerous real-world examples, showing you how these techniques can be used to tackle longstanding problems. Next, explore the design of wireless networks as platforms for machine learning applications – an overview of modern machine learning techniques and communication protocols will help you to understand the challenges, while new methods and design approaches will be presented to handle wireless channel impairments such as noise and interference, to meet the demands of emerging machine learning applications at the wireless edge.

Human–Computer Interaction (HCI) is the current challenging issue of research and information technology. The areas of recent research like Usability Engineering, Cognitive Architectures, Spoken Dialogue System and Recommender Systems are covered in the book. Besides, the new dimensions of HCI, such as Ontological Engineering, Ambient Intelligence and Ubiquitous Computing are also introduced. Design methodologies of Spoken Dialogue System and the corresponding mathematic models are also presented, whereas the main emphasis is given on the simple presentation and making the cognition process easier for the learners. The book is an invaluable tool for the undergraduate and postgraduate students of computer science and engineering, and information technology. In addition, it is of immense value for the postgraduate students of computer application. Besides, researchers will be benefitted from Chapter 3 (Modelling of Understanding Process) and Chapter 5 (Recommender Systems) as these are based on the review of cognitive architectures and ontological tools. Software engineers will find the book useful especially for the contents of Chapter 2 (Usability Engineering). Technology innovators will appreciate Chapter 7 (Ambient Intelligence—The New Dimension of Human–Computer Interaction), which discusses advanced technologies, such as Ambient Intelligence, Middleware Technologies and Ubiquitous Computing. Information specialists and web designers will have an interesting experience with Chapter 6 (Advanced Visualisation Methods) that deals with advanced visualisation techniques.

The application of Deep Reinforcement Learning (DRL) in economics has been an area of active research in recent years. A number of recent works have shown how deep reinforcement learning can be used to study a variety of economic problems, including optimal policy-making, game theory, and bounded rationality. In this paper, after a theoretical introduction to deep reinforcement learning and various DRL algorithms, we provide an overview of the literature on deep reinforcement learning in economics, with a focus on the main applications of deep reinforcement learning in macromodeling. Then, we analyze the potentials and limitations of deep reinforcement learning in macroeconomics and identify a number of issues that need to be addressed in order for deep reinforcement learning to be more widely used in macro modeling.

Today, machine learning is being applied to a growing variety of problems in a bewildering variety of domains. A fundamental challenge when using machine learning is connecting the abstract mathematics of a machine learning technique to a concrete, real world problem. This book tackles this challenge through model-based machine learning which focuses on understanding the assumptions encoded in a machine learning system and their corresponding impact on the behaviour of the system. The key ideas of model-based machine learning are introduced through a series of case studies involving real-world applications. Case studies play a central role because it is only in the context of applications that it makes sense to discuss modelling assumptions. Each chapter introduces one case study and works through step-by-step to solve it using a model-based approach. The aim is not just to explain machine learning methods, but also showcase how to create, debug, and evolve them to solve a problem. Features: Explores the assumptions being made by machine learning systems and the effect these assumptions have when the system is applied to concrete problems. Explains machine learning concepts as they arise in real-world case studies. Shows how to diagnose, understand and address problems with machine learning systems. Full source code available, allowing models and results to be reproduced and explored. Includes optional deep-dive sections with more mathematical details on inference algorithms for the interested reader.

This volume features the complete text of all regular papers, posters, and summaries of symposia presented at the 17th annual meeting of the Cognitive Science Society.

Consider the problem of a robot (algorithm, learning mechanism) moving along the real line attempting to locate a particular point ? . To assist the me- anism, we assume that it can communicate with an Environment (“Oracle”) which guides it with information regarding the direction in which it should go. If the Environment is deterministic the problem is the “Deterministic Point - cation Problem” which has been studied rather thoroughly [1]. In its pioneering version [1] the problem was presented in the setting that the Environment could charge the robot a cost which was proportional to the distance it was from the point sought for. The question of having multiple communicating robots locate a point on the line has also been studied [1, 2]. In the stochastic version of this problem, we consider the scenario when the learning mechanism attempts to locate a point in an interval with stochastic (i. e. , possibly erroneous) instead of deterministic responses from the environment. Thus when it should really be moving to the “right” it may be advised to move to the “left” and vice versa. Apart from the problem being of importance in its own right, the stoch- tic pointlocationproblemalsohas potentialapplications insolvingoptimization problems. Inmanyoptimizationsolutions–forexampleinimageprocessing,p- tern recognition and neural computing [5, 9, 11, 12, 14, 16, 19], the algorithm worksits wayfromits currentsolutionto the optimalsolutionbasedoninfor- tion that it currentlyhas. A crucialquestionis oneof determining the parameter whichtheoptimizationalgorithmshoulduse.

This edited book gives a comprehensive picture of the state of the art in authoring systems and authoring tools for advanced technology instructional systems. It includes descriptions of fifteen systems and research projects from almost every significant effort in the field. The book will appeal to researchers, teachers and advanced students working in education, instructional technology and computer-based education, psychology, cognitive science and computer science.