This issue of New Directions for Evaluation (NDE) marks a milestone: the 25th anniversary of the American Evaluation Association (AEA). NDE is an official publication of AEA and has been a crucial means for the Association to foster and promote the professionalization of evaluation through thematic discussions of theory and practice in evaluation. NDE was first published in 1978 under the name New Directions for Program Evaluation, although the title became New Directions for Evaluation in 1995 in acknowledgement of the broader scope of evaluation.
This issue discusses ways of constructing, organizing, and managing arguments for evaluation. Not focued solely on the logic of evaluation or predictive validity, it discusses the various elements needed to construct evaluation arguments that are compelling and influential by virtue of the truth, beauty, and justice they express. Through exposition, original research, critical reflection, and application to case examples, the authors present tools, perspectives, and guides to help evaluators navigate the complex contexts of evaluation in the 21st century. This is the 142nd issue in the New Directions for Evaluation series from Jossey-Bass. It is an official publication of the American Evaluation Association.
Nowadays, a considerable amount of evaluation work is implemented internally—both nationally and across the world. As such, it is exceedingly important for evaluators and organizations to be aware of the issues in designing and implementing internal evaluation to realize its potential for enhancing organizational growth, competitive advantage, and social impact. This issue includes perspectives on internal evaluation from experienced evaluation practitioners from different fields and organizations who share theoretical and practical examples and case studies in promoting and conducting internal evaluation. The chapters: Highlight societal and organizational changes that have shaped the current trends in internal evaluation Discuss foundational issues in internal evaluation Provide rich illustrations of internal evaluation practice in different settings with diverse foci (customer-driven vision and a results-based orientation for evaluation, accountability and development, and building evaluation capacity). This is the 132nd volume of the Jossey-Bass quarterly report series New Directions for Evaluation, an official publication of the American Evaluation Association.
Hear from evaluation practitioners throughout Latin America. In this region program evaluation is an emergent practice, one that is shaped by distinctive geopolitical and social contexts and has its own intellectual biography. Through a selection of writings and cases this issue provides a window on program evaluation in this region. The articles indicate a range of experiences and concerns that respond to the countries’ unique histories and cultures. Articles by evaluators from Argentina, Brazil, Chile, Colombia, Costa Rica, and Peru illustrate new directions and are grouped around the following themes: Strategic use of evaluation in public policies and active citizenship Innovative project evaluation examples Evaluation capacity building and institutionalization. The widespread development of participatory or actor-oriented approaches, based on qualitative methodologies that have a particularly Latin American stamp, are emphasized in this issue. This is the 134th volume of the Jossey-Bass quarterly report series New Directions for Evaluation, an official publication of the American Evaluation Association.
This issue focuses on connections between performance management and evaluation, a contentious topic at the moment. It does so by placing evaluation and monitoring under the overarching concept of performance management, and then by investigating five complementarities between performance monitoring and measurement on the one hand, and evaluation on the other. These complementarities are: Sequential Informational Organizational Methodical Hierarchical. Several case studies discuss the uses and complementarities of evaluation and performance management in contexts including national and local governments and the work of government, philanthropic foundations, and a direct-service nonprofit agency. These cases illustrate the advantages and pitfalls in utilizing evaluative approaches within the context of performance management. This is the 137th volume of the Jossey-Bass quarterly report series New Directions for Evaluation, an official publication of the American Evaluation Association.
Gain a greater understanding of organizational capacity to do and use evaluation and implications for evaluation capacity building (ECB). This volume is unique in that it represents a multiple case study of eight organizations that were committed to ECB. It: Situates the study in terms of ECB theory and research Delineates a conceptual framework Presents case profile reports and the results of a cross-case analysis. Discusses findings in terms of implications for research, theory, and practice. This is the 141st issue in the New Directions for Evaluation series from Jossey-Bass. It is an official publication of the American Evaluation Association.
An updated guide to the core concepts of program evaluation This updated edition of Program Evaluation in Practice covers the core concepts of program evaluation and uses case studies to touch on real-world issues that arise when conducting an evaluation project. This important resource is filled with illustrative examples written in accessible terms and provides a wide variety of evaluation projects that can be used for discussion, analysis, and reflection. The book addresses foundations and theories of evaluation, tools and methods for collecting data, writing of reports, and the sharing of findings. The discussion questions and class activities at the end of each chapter are designed to help process the information in that chapter and to integrate the information from the other chapters, thus facilitating the learning process. As useful for students as it is for evaluators in training, Program Evaluation in Practice is a must-have text for those aspiring to be effective evaluators. Includes expanded discussion of basic theories and approaches to program evaluation Features a new chapter on objective-based evaluation and a new section on ethics in program evaluation Provides more detailed information and in-depth description for each case, including evaluation approaches, fresh references, new readings, and the new Joint Committee Standards for Evaluation
This issue delivers concrete suggestions for optimally using data visualization in evaluation, as well as suggestions for best practices in data visualization design. It focuses on specific quantitative and qualitative data visualization approaches that include data dashboards, graphic recording, and geographic information systems (GIS). Readers will get a step-by-step process for designing an effective data dashboard system for programs and organizations, and various suggestions to improve their utility. The next section illustrates the role that graphic recording can play in helping programs and evaluators understand and communicate the mission and impact that an intervention is having in a democratic and culturally competent way. The GIS section provides specific examples of how mapped data can be used to understand program implementation and effectiveness, and the influence that the environment has on these outcomes. Discusses best practices that inform and shape our data visualization design choices Highlights the best use of each tool/approach Provides suggestions for effective practice Discuss the strengths and limitations of each approach in evaluation practice This is the 140th volume of the Jossey-Bass quarterly report series New Directions for Evaluation, an official publication of the American Evaluation Association.
Do you make evidence-based decisions when designing and conducting evaluations, and use methods validated by experience? Because of the growing importance of evidence-based decision-making for improving programs and policies, this issue examines methods selection: Which is better? How can one be improved? Are the results of the project worth the resources expended? and how that leads to confidence in value-based conclusions. It presents a constructive dialogue on valuing in evaluation, with the goal of developing a pragmatic approach for guiding method choice and for promoting methodology policies that support multiple approaches to valuation being employed in context-appropriate ways so as to serve the public interest. This is the 133rd volume of the Jossey-Bass quarterly report series New Directions for Evaluation, an official publication of the American Evaluation Association.
Underrepresentation of women in science, technology, engineering and mathematics fields is a problem that has persisted over the past three decades and is most severe at the highest levels of the STEM career path. Although national attention has been directed toward increasing the presence of women in STEM, women continue to leave at critical junctures in STEM training and careers at a higher rate than men. This volume of New Directions for Institutional Research takes a comprehensive look at the status of women in STEM and considers related factors, theoretical perspectives, and innovative tools that have the potential to help scholars understand, study, and improve the experiences of women in STEM fields. This is the 152nd volume of New Directions for Institutional Research. Always timely and comprehensive, New Directions for Institutional Research provides planners and administrators in all types of academic institutions with guidelines in such areas as resource coordination, information analysis, program evaluation, and institutional management.
Advisory committees are used often in evaluation studies, yet this practice is little discussed or reported. This issue is the first full-length text devoted to the purpose, practice, and scholarship about this type of formal, structured advice. It includes case studies and analyses of these to answer such basic topics as: What is an evaluation advisory group (EAG)? Why (not) use an EAG? How to organize an EAG, and how to evaluate it? The reader will learn how to view the EAG as a structure of expertise, its use for political legitimacy, and as a response to a variety of constituencies. Guidelines on how to recruit, select, orient, train, monitor, assess, and evaluate EAG members are also included. This is the 136th volume of the Jossey-Bass quarterly report series New Directions for Evaluation, an official publication of the American Evaluation Association.
While the term benchmarking is commonplace nowadays in institutional research and higher education, less common, is a solid understanding of what it really means and how it has been, and can be, used effectively. This volume begins by defining benchmarking as “a strategic and structured approach whereby an organization compares aspects of its processes and/or outcomes to those of another organization or set of organizations to identify opportunities for improvement.” Building on this definition, the chapters provide a brief history of the evolution and emergence of benchmarking in general and in higher education in particular. The authors apply benchmarking to: Enrollment management and student success Institutional effectiveness The potential economic impact of higher education institutions on their host communities. They look at the use of national external survey data in institutional benchmarking and selection of peer institutions, introduce multivariate statistical methodologies for guiding that selection, and consider a novel application of baseball sabermetric methods. The volume offers a solid starting point for those new to benchmarking in higher education and provides examples of current best practices and prospective new directions. This is the 156th volume of this Jossey-Bass series. Always timely and comprehensive, New Directions for Institutional Research provides planners and administrators in all types of academic institutions with guidelines in such areas as resource coordination, information analysis, program evaluation, and institutional management.
The golden standard evaluation reference text Now in its second edition, Evaluation Theory, Models, and Applications is the vital text on evaluation models, perfect for classroom use as a textbook, and as a professional evaluation reference. The book begins with an overview of the evaluation field and program evaluation standards, and proceeds to cover the most widely used evaluation approaches. With new evaluation designs and the inclusion of the latest literature from the field, this Second Edition is an essential update for professionals and students who want to stay current. Understanding and choosing evaluation approaches is critical to many professions, and Evaluation Theory, Models, and Applications, Second Edition is the benchmark evaluation guide. Authors Daniel L. Stufflebeam and Chris L. S. Coryn, widely considered experts in the evaluation field, introduce and describe 23 program evaluation approaches, including, new to this edition, transformative evaluation, participatory evaluation, consumer feedback, and meta-analysis. Evaluation Theory, Models, and Applications, Second Edition facilitates the process of planning, conducting, and assessing program evaluations. The highlighted evaluation approaches include: Experimental and quasi-experimental design evaluations Daniel L. Stufflebeam's CIPP Model Michael Scriven's Consumer-Oriented Evaluation Michael Patton's Utilization-Focused Evaluation Robert Stake's Responsive/Stakeholder-Centered Evaluation Case Study Evaluation Key readings listed at the end of each chapter direct readers to the most important references for each topic. Learning objectives, review questions, student exercises, and instructor support materials complete the collection of tools. Choosing from evaluation approaches can be an overwhelming process, but Evaluation Theory, Models, and Applications, Second Edition updates the core evaluation concepts with the latest research, making this complex field accessible in just one book.
This is the first New Directions volume related to young adult learners since 1984. Then, as now, young adults are an important segment of the adult population but have received scant attention in the adult education literature. Increasingly, youths and young adults are enrolling in adult education programs and in doing so are changing the meaning of adulthood. Given the significant demographic, technological, and cultural shifts during the past 30 years, there is an increasing need for practitioners and program planners to reconsider what constitutes “adult” and “adult education.” An understanding of the changing meaning of adulthood is fundamental to developing programs and policies that will address the needs of younger learners, and we believe it is time for an updated discussion among adult educators and scholars in other disciplines. This sourcebook is designed to reignite the discussion related to meeting the educational needs of young adults along with a timely and interdisciplinary discussion that highlights the transitional needs of young adult learners. This is the 143rd volume of the Jossey Bass series New Directions for Adult and Continuing Education. Noted for its depth of coverage, it explores issues of common interest to instructors, administrators, counselors, and policymakers in a broad range of education settings, such as colleges and universities, extension programs, businesses, libraries, and museums.
The Sociology of Medical Screening: Critical Perspectives, New Directions presents a series of readings that provide an up-to-date overview of the diverse sociological issues relating to population-based medical screening. Features new research data in most of the contributions Includes contributions from eminent sociologists such as David Armstrong, Stefan Timmermans, and Alison Pilnick Represents one of the only collections to specifically address the sociology of medical screening
What factors contribute to students’ lasting success? Much research has explored the impact of the first year of college on student retention and success. With the new performance-based funding initiatives, institutional administrators are taking a laser-focused approach to aligning retention and success strategies to first-year student transition points. This volume enlightens the discussion and highlights new directions for assessment and research practices within the scope of the first year experience. Administrators, faculty, and data scientists provide a conceptual and analytical approach to investigating the first-year experience for entry-level and seasoned practitioners alike. The emerging research throughout this volume suggests that while many first-year programs and services have significant benefits across a number of success outcomes, these benefits may not be universal for all students. This volume: Examines sophisticated empirical models Provides critical assessment practices and implications. Examines the four-year college and the two-year institution, which is just as critical. This is the 161st volume of this Jossey-Bass quarterly report series. Timely and comprehensive, New Directions for Institutional Research provides planners and administrators in all types of academic institutions with guidelines in such areas as resource coordination, information analysis, program evaluation, and institutional management.