Do you make evidence-based decisions when designing and conducting evaluations, and use methods validated by experience? Because of the growing importance of evidence-based decision-making for improving programs and policies, this issue examines methods selection: Which is better? How can one be improved? Are the results of the project worth the resources expended? and how that leads to confidence in value-based conclusions. It presents a constructive dialogue on valuing in evaluation, with the goal of developing a pragmatic approach for guiding method choice and for promoting methodology policies that support multiple approaches to valuation being employed in context-appropriate ways so as to serve the public interest. This is the 133rd volume of the Jossey-Bass quarterly report series New Directions for Evaluation, an official publication of the American Evaluation Association.

Much applied research takes place as if complex social problems--and evaluations of interventions to address them--can be dealt with in a purely technical way. In contrast, this groundbreaking book offers an alternative approach that incorporates sustained, systematic reflection about researchers' values, what values research promotes, how decisions about what to value are made and by whom, and how judging the value of social interventions takes place. The authors offer practical and conceptual guidance to help researchers engage meaningfully with value conflicts and refine their capacity to engage in deliberative argumentation. Pedagogical features include a detailed evaluation case, "Bridge to Practice" exercises and annotated resources in most chapters, and an end-of-book glossary.

The Fifth Edition of the bestselling Utilization-Focused Evaluation provides expert, detailed advice on conducting evaluations that promote effective use of the findings. Chock full of useful pedagogy, this book presents Michael Quinn Patton′s distinctive opinions based on more than forty years of experience, and also the expertise of new co-author Charmagne E. Campbell-Patton. The authors begin by describing the essence of utilization-focused evaluation, and then outline 10 operating principles. They conclude with chapters focused on how evaluation can be used to promote a more thoughtful, equitable, and sustainable world. Richly illustrated with examples, figures, and cartoons, this engaging text shows readers how to design and conduct evaluations that provide useful findings, and which contribute to a more equitable society. A companion website is available to accompany this book.

Addressing one of the most important and contentious issues challenging applied research and evaluation practice today—what constitutes credible and actionable evidence?—this volume offers a balanced and current context in which to analyze the long-debated quantitative-qualitative paradigms. In the Second Edition, the contributors, a veritable “who’s who” in evaluation, discuss the diversity and changing nature of credible and actionable evidence; offer authoritative guidance about using credible and actionable evidence; explain how to use it to provide rigorous and influential evaluations; and include lessons from their own applied research and evaluation to suggest ways to address the key issues and challenges. Reflecting the latest developments in the field and covering both experimental and non-experimental methods, the new edition includes revised and updated chapters, summaries of strengths and weaknesses across varied approaches, and contains diverse definitions of evidence. Also included are two new chapters on assessing credibility and synthesizing evidence for policy makers. This is a valuable resource for students and others interested in how to best study and evaluate programs, policies, organizations, and other initiatives designed to improve aspects of the human condition and societal well-being.

This issue broaden the field’s understanding of Research on Evaluation (RoE) in practice, with a focus on empirical RoE. Considering the full collection of RoE studies, it defines RoE as systematic empirical inquiry resulting in original findings or in reexaminations of existing data about the practice, methods, or profession of program evaluation. RoE inquiries address: the inputs into evaluations, the contexts within which evaluations are conducted, the full range of methods and activities of evaluations, evaluation’s proximal or distal effects, or the professional issues that evaluators encounter. The inquiries include case studies, reflective narratives, studies about evaluation methods, literature reviews, oral histories, bibliometric studies, meta-evaluations, experiments, longitudinal studies, simulations, and time-series studies. This is the 148th issue in the New Directions for Evaluation series from Jossey-Bass. It is an official publication of the American Evaluation Association.

This book discusses the crucial place that assumptions hold in conceptualizing, implementing, and evaluating development programs. It suggests simple ways for stakeholders and evaluators to 1) examine their assumptions about program theory and environmental conditions and 2) develop and carry out effective program monitoring and evaluation in light of those assumptions. A survey of evaluators from an international development agency reviewed the state of practice on assumptions-aware evaluation. This 2nd edition has been updated with further illustrations, case studies, and frameworks that have been researched and tested in the years since the first edition. Regardless of geography or goal, development programs and policies are fueled by a complex network of implicit ideas. Stakeholders may hold assumptions about purposes, outcomes, methodology, and the value of project evaluation and evaluators—which may or may not be shared by the evaluators. A major barrier to viable program evaluations is that development programs are based on assumptions that often are not well articulated. In designing programs, stakeholders often lack clear outlines for how implemented interventions will bring desired changes. This lack of clarity masks critical risks to program success and makes it challenging to evaluate such programs. Methods that have attempted to address this dilemma have been popularized as theory of change or other theory‐based approaches. Often, however, theory-based methods do not sufficiently clarify how program managers or evaluators should work with the assumptions inherent in the connections between the steps. The critical examination of assumptions in evaluation is essential for effective evaluations and evaluative thinking. "How does one think evaluatively? It all begins with assumptions. Systematically articulating, examining, and testing assumptions is the foundation of evaluative thinking... This book, more than any other, explains how to build a strong foundation for effective interventions and useful evaluation by rigorously working with assumptions." —Michael Quinn Patton, PhD. Author of Utilization-Focused Evaluation and co-editor of THOUGHTWORK: Thinking, Action, and the Fate of the World, USA. "This updated edition presents us with a new opportunity to delve into both the theoretical and practical aspects of paradigmatic, prescriptive, and causal assumptions. We need to learn, and apply these insights with the deep attention they deserve." —Zenda Ofir, PhD. Independent Evaluator, Richard von Weizsäcker Fellow, Robert Bosch Academy, Berlin, Germany. Honorary Professor, School of Public Leadership, Stellenbosch University, South Africa. “This thought-provoking book explains why assumptions are an essential condition within the theories and methodologies of evaluation; and how assumptions influence the ways that evaluators approach their work...It will enrich the ways that evaluators develop their models, devise their methodologies, interpret their data, and interact with their stakeholders.” —Jonny Morell, Ph.D., President, 4.669... Evaluation and Planning, Editor Emeritus, Evaluation and Program Planning

In the emerging fields of religious and interreligious peacebuilding, the question of monitoring and evaluation is a challenging, yet necessary process. The need to develop comprehensive yet fitting evaluation models for religious and interreligious peacebuilding is not only important for donor interests, but also critical as a means of documenting and learning for peacebuilders themselves. Theories and best practices in monitoring and evaluation have become prevalent in many fields, yet the amount of literature on evaluating intercultural and, especially, religious and interreligious projects remains scant in comparison. This volume offers a unique contribution that not only looks at several of the challenges and implications faced by religious and interreligious peacebuilders but also provides concrete examples of new models and tools for monitoring and evaluating religious and interreligious peacebuilding projects. In doing so, this volume serves as a tool and point of reference for individuals and organizations developing and implementing interreligious dialogue and peacebuilding projects.

The notion of quality features prominently in contemporary discourse. Numerous ratings, rankings, metrics, auditing, accreditation, benchmarking, smileys, reviews, and international comparisons are all used regularly to capture quality. This book paves the way in exploring the socio-political implications of evaluative statements, with a specific focus on the contribution of the concept of quality to these processes. Drawing on perspectives from the history of ideas, sociology, political science and public management, Dahler-Larsen asks what is the role of quality, and more specifically quality inscriptions, such as measurement? What do they accomplish? And finally, as a consequence of all this, does the term quality make it possible to deal with public issues in a way that lives up to democratic standards? This cross-disciplinary book will be of interest to scholars and students across various fields, including sociology, social epistemology, political science, public policy, and evaluation.

In the Research Handbook on Program Evaluation, an impressive range of authors take stock of the history and current standing of key issues and debates in the evaluation field. Examining current literature of program evaluation, the Research Handbook assesses the field's status in a post-pandemic and social justice-oriented world, examining today’s theoretical and practical concerns and proposing how they might be resolved by future innovations. This title contains one or more Open Access chapters.

Evaluation examines policies and programs across every arena of human endeavor, from efforts to stop the spread of HIV/AIDS to programs that drive national science policy. Relying on a vast array of methods, from qualitative interviewing to econometrics, it is a "transdiscipline," as opposed to a formal area of academic study. Accounting for these challenges, Evaluation Foundations Revisited offers an introduction for those seeking to better understand evaluation as a professional field. While the acquisition of methods and methodologies to meet the needs of certain projects is important, the foundation of evaluative practice rests on understanding complex issues to balance. Evaluation Foundations Revisited is an invitation to examine the intellectual, practical, and philosophical nexus that lies at the heart of evaluation. Thomas A. Schwandt shows how to critically engage with the assumptions that underlie how evaluators define and position their work, as well as how they argue for the usefulness of evaluation in society. He looks at issues such as the role of theory, how notions of value and valuing are understood, how evidence is used, how evaluation is related to politics, and what comprises scientific integrity. By coming to better understand the foundations of evaluation, readers will develop what Schwandt terms "a life of the mind of practice," which enables evaluators to draw on a more holistic view to develop reasoned arguments and well fitted techniques.