This volume presents the proceedings of the Fourth International Workshop on Analogical and Inductive Inference (AII '94) and the Fifth International Workshop on Algorithmic Learning Theory (ALT '94), held jointly at Reinhardsbrunn Castle, Germany in October 1994. (In future the AII and ALT workshops will be amalgamated and held under the single title of Algorithmic Learning Theory.) The book contains revised versions of 45 papers on all current aspects of computational learning theory; in particular, algorithmic learning, machine learning, analogical inference, inductive logic, case-based reasoning, and formal language learning are addressed.

This volume contains the papers presented at the 21st International Conf- ence on Algorithmic Learning Theory (ALT 2010), which was held in Canberra, Australia, October 6–8, 2010. The conference was co-located with the 13th - ternational Conference on Discovery Science (DS 2010) and with the Machine Learning Summer School, which was held just before ALT 2010. The tech- cal program of ALT 2010, contained 26 papers selected from 44 submissions and ?ve invited talks. The invited talks were presented in joint sessions of both conferences. ALT 2010 was dedicated to the theoretical foundations of machine learning and took place on the campus of the Australian National University, Canberra, Australia. ALT provides a forum for high-quality talks with a strong theore- cal background and scienti?c interchange in areas such as inductive inference, universal prediction, teaching models, grammatical inference, formal languages, inductive logic programming, query learning, complexity of learning, on-line learning and relative loss bounds, semi-supervised and unsupervised learning, clustering,activelearning,statisticallearning,supportvectormachines,Vapnik- Chervonenkisdimension,probablyapproximatelycorrectlearning,Bayesianand causal networks, boosting and bagging, information-based methods, minimum descriptionlength,Kolmogorovcomplexity,kernels,graphlearning,decisiontree methods, Markov decision processes, reinforcement learning, and real-world - plications of algorithmic learning theory. DS 2010 was the 13th International Conference on Discovery Science and focused on the development and analysis of methods for intelligent data an- ysis, knowledge discovery and machine learning, as well as their application to scienti?c knowledge discovery. As is the tradition, it was co-located and held in parallel with Algorithmic Learning Theory.

This book constitutes the refereed proceedings of the 11th International Conference on Algorithmic Learning Theory, ALT 2000, held in Sydney, Australia in December 2000. The 22 revised full papers presented together with three invited papers were carefully reviewed and selected from 39 submissions. The papers are organized in topical sections on statistical learning, inductive logic programming, inductive inference, complexity, neural networks and other paradigms, support vector machines.

This book constitutes the refereed proceedings of the 10th International Conference on Algorithmic Learning Theory, ALT'99, held in Tokyo, Japan, in December 1999. The 26 full papers presented were carefully reviewed and selected from a total of 51 submissions. Also included are three invited papers. The papers are organized in sections on Learning Dimension, Inductive Inference, Inductive Logic Programming, PAC Learning, Mathematical Tools for Learning, Learning Recursive Functions, Query Learning and On-Line Learning.

This volume contains all the papers presented at the Ninth International Con- rence on Algorithmic Learning Theory (ALT’98), held at the European education centre Europ ̈aisches Bildungszentrum (ebz) Otzenhausen, Germany, October 8{ 10, 1998. The Conference was sponsored by the Japanese Society for Arti cial Intelligence (JSAI) and the University of Kaiserslautern. Thirty-four papers on all aspects of algorithmic learning theory and related areas were submitted, all electronically. Twenty-six papers were accepted by the program committee based on originality, quality, and relevance to the theory of machine learning. Additionally, three invited talks presented by Akira Maruoka of Tohoku University, Arun Sharma of the University of New South Wales, and Stefan Wrobel from GMD, respectively, were featured at the conference. We would like to express our sincere gratitude to our invited speakers for sharing with us their insights on new and exciting developments in their areas of research. This conference is the ninth in a series of annual meetings established in 1990. The ALT series focuses on all areas related to algorithmic learning theory including (but not limited to): the theory of machine learning, the design and analysis of learning algorithms, computational logic of/for machine discovery, inductive inference of recursive functions and recursively enumerable languages, learning via queries, learning by arti cial and biological neural networks, pattern recognition, learning by analogy, statistical learning, Bayesian/MDL estimation, inductive logic programming, robotics, application of learning to databases, and gene analyses.

This volume contains papers presented at the 19th International Conference on Algorithmic Learning Theory (ALT 2008), which was held in Budapest, Hungary during October 13–16, 2008. The conference was co-located with the 11th - ternational Conference on Discovery Science (DS 2008). The technical program of ALT 2008 contained 31 papers selected from 46 submissions, and 5 invited talks. The invited talks were presented in joint sessions of both conferences. ALT 2008 was the 19th in the ALT conference series, established in Japan in 1990. The series Analogical and Inductive Inference is a predecessor of this series: it was held in 1986, 1989 and 1992, co-located with ALT in 1994, and s- sequently merged with ALT. ALT maintains its strong connections to Japan, but has also been held in other countries, such as Australia, Germany, Italy, Sin- pore, Spain and the USA. The ALT conference series is supervised by its Steering Committee: Naoki Abe (IBM T. J.

Algorithmic learning theory is mathematics about computer programs which learn from experience. This involves considerable interaction between various mathematical disciplines including theory of computation, statistics, and c- binatorics. There is also considerable interaction with the practical, empirical ?elds of machine and statistical learning in which a principal aim is to predict, from past data about phenomena, useful features of future data from the same phenomena. The papers in this volume cover a broad range of topics of current research in the ?eld of algorithmic learning theory. We have divided the 29 technical, contributed papers in this volume into eight categories (corresponding to eight sessions) re?ecting this broad range. The categories featured are Inductive Inf- ence, Approximate Optimization Algorithms, Online Sequence Prediction, S- tistical Analysis of Unlabeled Data, PAC Learning & Boosting, Statistical - pervisedLearning,LogicBasedLearning,andQuery&ReinforcementLearning. Below we give a brief overview of the ?eld, placing each of these topics in the general context of the ?eld. Formal models of automated learning re?ect various facets of the wide range of activities that can be viewed as learning. A ?rst dichotomy is between viewing learning as an inde?nite process and viewing it as a ?nite activity with a de?ned termination. Inductive Inference models focus on inde?nite learning processes, requiring only eventual success of the learner to converge to a satisfactory conclusion.

This book constitutes the refereed proceedings of the 16th International Conference on Algorithmic Learning Theory, ALT 2005, held in Singapore in October 2005. The 30 revised full papers presented together with 5 invited papers and an introduction by the editors were carefully reviewed and selected from 98 submissions. The papers are organized in topical sections on kernel-based learning, bayesian and statistical models, PAC-learning, query-learning, inductive inference, language learning, learning and logic, learning from expert advice, online learning, defensive forecasting, and teaching.

This book constitutes the proceedings of the 26th International Conference on Algorithmic Learning Theory, ALT 2015, held in Banff, AB, Canada, in October 2015, and co-located with the 18th International Conference on Discovery Science, DS 2015. The 23 full papers presented in this volume were carefully reviewed and selected from 44 submissions. In addition the book contains 2 full papers summarizing the invited talks and 2 abstracts of invited talks. The papers are organized in topical sections named: inductive inference; learning from queries, teaching complexity; computational learning theory and algorithms; statistical learning theory and sample complexity; online learning, stochastic optimization; and Kolmogorov complexity, algorithmic information theory.

This book constitutes the refereed proceedings of the 7th International Workshop on Algorithmic Learning Theory, ALT '96, held in Sydney, Australia, in October 1996. The 16 revised full papers presented were selected from 41 submissions; also included are eight short papers as well as four full length invited contributions by Ross Quinlan, Takeshi Shinohara, Leslie Valiant, and Paul Vitanyi, and an introduction by the volume editors. The book covers all areas related to algorithmic learning theory, ranging from theoretical foundations of machine learning to applications in several areas.