Technological and theoretical changes over the past decade have altered the way we think about test validity. This book addresses the present and future concerns raised by these developments. Topics discussed include: * the validity of computerized testing * the validity of testing for specialized populations (e.g., minorities, the handicapped) and * new analytic tools to study and measure validity

This volume presents the first wide-ranging critical review of validity generalization (VG)--a method that has dominated the field since the publication of Schmidt and Hunter's (1977) paper "Development of a General Solution to the Problem of Validity Generalization." This paper and the work that followed had a profound impact on the science and practice of applied psychology. The research suggests that fundamental relationships among tests and criteria, and the constructs they represent are simpler and more regular than they appear. Looking at the history of the VG model and its impact on personnel psychology, top scholars and leading researchers of the field review the accomplishments of the model, as well as the continuing controversies. Several chapters significantly extend the maximum likelihood estimation with existing models for meta analysis and VG. Reviewing 25 years of progress in the field, this volume shows how the model can be extended and applied to new problems and domains. This book will be important to researchers and graduate students in the areas of industrial organizational psychology and statistics.

Applied Behavior Analysis is the science of applying experimentally derived principles of behavior to improve socially significant behavior. The research and application of ABA contributes to a wide range of practical areas, including AIDS prevention, education, gerontology, language acquisition and parenting, and ABA-based interventions have gained particular popularity in the last 20 years related to teaching students with autism spectrum disorders. Social Validity, a concept used in such behavioral intervention research, focuses on whether the goals of treatment, the intervention techniques used and the outcomes achieved are acceptable, relevant, and useful to the individual in treatment. Judgments are made (often via clinical trials) about the effects of the intervention based on statistical significance and magnitude of effect. Essentially, social validity alerts us as to whether or not the ABA-based intervention has had a palpable impact and actually helped people in ways that are evident in everyday life. This clinical research volume offers a detailed evaluation of the extant findings on Social Validity, as well as discussion of newly emerging factors which reemphasize the need for well-developed methods of examining SV. Basic conceptualizations, measurement, research findings, applications, ethics, and future implications are discussed in full, and novel recommendations relating back to clinical treatment are provided. The volume will give readers a firm understanding of the general concept of SV, help them become familiar with the research methods and findings, and teach them how to establish and evaluate the Social Validity of individual interventions and treatment programs. - Consolidates literature broadly distributed across journals and book chapters into single source - Provides discussion of SV in greater depth and breadth than is found in other sources, which generally just focus on general conceptualization and broad research findings - Describes how concept of SV can be influential in numerous areas of clinical practice

Validity is the hallmark of quality for educational and psychological measurement. But what does quality mean in this context? And to what, exactly, does the concept of validity apply? These apparently innocuous questions parachute the unwary inquirer into a minefield of tricky ideas. This book guides you through this minefield, investigating how the concept of validity has evolved from the nineteenth century to the present day. Communicating complicated concepts straightforwardly, the authors answer questions like: What does ′validity′ mean? What does it mean to ′validate′? How many different kinds of validity are there? When does validation begin and end? Is reliability a part of validity, or distinct from it? This book will be of interest to anyone with a professional or academic interest in evaluating the quality of educational or psychological assessments, measurements and diagnoses.

With examples of validation studies, this book demonstrates how to design research investigating the validity of language tests.

Exploring the influence and application of Campbellian validity typology in the theory and practice of outcome evaluation, this volume addresses the strengths and weaknesses of this often controversial evaluation method and presents new perspectives for its use. Editors Huey T. Chen, Stewart I. Donaldson and Melvin M. Mark provide a historical overview of the Campbellian typology adoption, contributions and criticism. Contributing authors propose strategies in developing a new perspective of validity typology for advancing validity in program evaluation including Enhance External Validity Enhance Precision by Reclassifying the Campbellian Typology Expand the Scope of the Typology The volume concludes with William R. Shadish's spirited rebuttal to earlier chapters. A collaborator with Don Campbell, Shadish provides a balance to the perspective of the issue with a clarification and defense of Campbell's work. This is the 129th volume of the Jossey-Bass quarterly report series New Directions for Evaluation, an official publication of the American Evaluation Association.

This issue discusses ways of constructing, organizing, and managing arguments for evaluation. Not focued solely on the logic of evaluation or predictive validity, it discusses the various elements needed to construct evaluation arguments that are compelling and influential by virtue of the truth, beauty, and justice they express. Through exposition, original research, critical reflection, and application to case examples, the authors present tools, perspectives, and guides to help evaluators navigate the complex contexts of evaluation in the 21st century. This is the 142nd issue in the New Directions for Evaluation series from Jossey-Bass. It is an official publication of the American Evaluation Association.

This edited volume presents a systematic analysis of conceptual, methodological and applied aspects related to the validation of educational tests used in Latin American countries. Inspired by international standards on educational measurement and evaluation, this book illustrates efforts that have been made in several countries to validate different types of educational assessments, including student learning assessments, measurements of non-cognitive aspects in students, teacher evaluations, and tests for certification and selection. It gathers the experience of validity studies from the main international assessments in Latin America (PISA, TIMSS, ERCE, and ICCS). Additionally, it shows the challenges that must be taken into account when evaluations are used to compare countries, groups or trends of achievement over time. The book builds on the premise that measurements in the educational field should not be used if there are no studies that support the validity of the interpretation of their scores, or the use made of such tests. It shows that, despite the recognition given to validity, relatively few educational measurement assessments have accumulated enough evidence to support their interpretation and use. In doing so, this volume increases awareness about the relevance of validity, especially when assessments are key component of educational policies.

This book focuses on assumptions underlying methods choice in program evaluation. Credible program evaluation extends beyond the accuracy of research designs to include arguments justifying the appropriateness of methods. An important part of this justification is explaining the assumptions made about the validity of methods. This book provides a framework for understanding methodological assumptions, identifying the decisions made at each stage of the evaluation process, the major forms of validity affected by those decisions, and the preconditions for and assumptions about those validities. Though the selection of appropriate research methodology is not a new topic within social development research, previous publications suggest only advantages and disadvantages of using various methods and when to use them. This book goes beyond other publications to analyze the assumptions underlying actual methodological choices in evaluation studies and how these eventually influence evaluation quality. The analysis offered is supported by a collation of assumptions collected from a case study of 34 evaluations. Due to its in-depth analysis, strong theoretical basis, and practice examples, Credibility, Validity and Assumptions is a must-have resource for researchers, students, university professors and practitioners in program evaluation. Importantly, it provides tools for the application of appropriate research methods in program evaluation