This issue of New Directions for Evaluation (NDE) marks a milestone: the 25th anniversary of the American Evaluation Association (AEA). NDE is an official publication of AEA and has been a crucial means for the Association to foster and promote the professionalization of evaluation through thematic discussions of theory and practice in evaluation. NDE was first published in 1978 under the name New Directions for Program Evaluation, although the title became New Directions for Evaluation in 1995 in acknowledgement of the broader scope of evaluation.
This issue discusses ways of constructing, organizing, and managing arguments for evaluation. Not focued solely on the logic of evaluation or predictive validity, it discusses the various elements needed to construct evaluation arguments that are compelling and influential by virtue of the truth, beauty, and justice they express. Through exposition, original research, critical reflection, and application to case examples, the authors present tools, perspectives, and guides to help evaluators navigate the complex contexts of evaluation in the 21st century. This is the 142nd issue in the New Directions for Evaluation series from Jossey-Bass. It is an official publication of the American Evaluation Association.
Nowadays, a considerable amount of evaluation work is implemented internally—both nationally and across the world. As such, it is exceedingly important for evaluators and organizations to be aware of the issues in designing and implementing internal evaluation to realize its potential for enhancing organizational growth, competitive advantage, and social impact. This issue includes perspectives on internal evaluation from experienced evaluation practitioners from different fields and organizations who share theoretical and practical examples and case studies in promoting and conducting internal evaluation. The chapters: Highlight societal and organizational changes that have shaped the current trends in internal evaluation Discuss foundational issues in internal evaluation Provide rich illustrations of internal evaluation practice in different settings with diverse foci (customer-driven vision and a results-based orientation for evaluation, accountability and development, and building evaluation capacity). This is the 132nd volume of the Jossey-Bass quarterly report series New Directions for Evaluation, an official publication of the American Evaluation Association.
Hear from evaluation practitioners throughout Latin America. In this region program evaluation is an emergent practice, one that is shaped by distinctive geopolitical and social contexts and has its own intellectual biography. Through a selection of writings and cases this issue provides a window on program evaluation in this region. The articles indicate a range of experiences and concerns that respond to the countries’ unique histories and cultures. Articles by evaluators from Argentina, Brazil, Chile, Colombia, Costa Rica, and Peru illustrate new directions and are grouped around the following themes: Strategic use of evaluation in public policies and active citizenship Innovative project evaluation examples Evaluation capacity building and institutionalization. The widespread development of participatory or actor-oriented approaches, based on qualitative methodologies that have a particularly Latin American stamp, are emphasized in this issue. This is the 134th volume of the Jossey-Bass quarterly report series New Directions for Evaluation, an official publication of the American Evaluation Association.
Gain a greater understanding of organizational capacity to do and use evaluation and implications for evaluation capacity building (ECB). This volume is unique in that it represents a multiple case study of eight organizations that were committed to ECB. It: Situates the study in terms of ECB theory and research Delineates a conceptual framework Presents case profile reports and the results of a cross-case analysis. Discusses findings in terms of implications for research, theory, and practice. This is the 141st issue in the New Directions for Evaluation series from Jossey-Bass. It is an official publication of the American Evaluation Association.
This issue focuses on connections between performance management and evaluation, a contentious topic at the moment. It does so by placing evaluation and monitoring under the overarching concept of performance management, and then by investigating five complementarities between performance monitoring and measurement on the one hand, and evaluation on the other. These complementarities are: Sequential Informational Organizational Methodical Hierarchical. Several case studies discuss the uses and complementarities of evaluation and performance management in contexts including national and local governments and the work of government, philanthropic foundations, and a direct-service nonprofit agency. These cases illustrate the advantages and pitfalls in utilizing evaluative approaches within the context of performance management. This is the 137th volume of the Jossey-Bass quarterly report series New Directions for Evaluation, an official publication of the American Evaluation Association.
An updated guide to the core concepts of program evaluation This updated edition of Program Evaluation in Practice covers the core concepts of program evaluation and uses case studies to touch on real-world issues that arise when conducting an evaluation project. This important resource is filled with illustrative examples written in accessible terms and provides a wide variety of evaluation projects that can be used for discussion, analysis, and reflection. The book addresses foundations and theories of evaluation, tools and methods for collecting data, writing of reports, and the sharing of findings. The discussion questions and class activities at the end of each chapter are designed to help process the information in that chapter and to integrate the information from the other chapters, thus facilitating the learning process. As useful for students as it is for evaluators in training, Program Evaluation in Practice is a must-have text for those aspiring to be effective evaluators. Includes expanded discussion of basic theories and approaches to program evaluation Features a new chapter on objective-based evaluation and a new section on ethics in program evaluation Provides more detailed information and in-depth description for each case, including evaluation approaches, fresh references, new readings, and the new Joint Committee Standards for Evaluation
This issue delivers concrete suggestions for optimally using data visualization in evaluation, as well as suggestions for best practices in data visualization design. It focuses on specific quantitative and qualitative data visualization approaches that include data dashboards, graphic recording, and geographic information systems (GIS). Readers will get a step-by-step process for designing an effective data dashboard system for programs and organizations, and various suggestions to improve their utility. The next section illustrates the role that graphic recording can play in helping programs and evaluators understand and communicate the mission and impact that an intervention is having in a democratic and culturally competent way. The GIS section provides specific examples of how mapped data can be used to understand program implementation and effectiveness, and the influence that the environment has on these outcomes. Discusses best practices that inform and shape our data visualization design choices Highlights the best use of each tool/approach Provides suggestions for effective practice Discuss the strengths and limitations of each approach in evaluation practice This is the 140th volume of the Jossey-Bass quarterly report series New Directions for Evaluation, an official publication of the American Evaluation Association.
Do you make evidence-based decisions when designing and conducting evaluations, and use methods validated by experience? Because of the growing importance of evidence-based decision-making for improving programs and policies, this issue examines methods selection: Which is better? How can one be improved? Are the results of the project worth the resources expended? and how that leads to confidence in value-based conclusions. It presents a constructive dialogue on valuing in evaluation, with the goal of developing a pragmatic approach for guiding method choice and for promoting methodology policies that support multiple approaches to valuation being employed in context-appropriate ways so as to serve the public interest. This is the 133rd volume of the Jossey-Bass quarterly report series New Directions for Evaluation, an official publication of the American Evaluation Association.
Underrepresentation of women in science, technology, engineering and mathematics fields is a problem that has persisted over the past three decades and is most severe at the highest levels of the STEM career path. Although national attention has been directed toward increasing the presence of women in STEM, women continue to leave at critical junctures in STEM training and careers at a higher rate than men. This volume of New Directions for Institutional Research takes a comprehensive look at the status of women in STEM and considers related factors, theoretical perspectives, and innovative tools that have the potential to help scholars understand, study, and improve the experiences of women in STEM fields. This is the 152nd volume of New Directions for Institutional Research. Always timely and comprehensive, New Directions for Institutional Research provides planners and administrators in all types of academic institutions with guidelines in such areas as resource coordination, information analysis, program evaluation, and institutional management.
Advisory committees are used often in evaluation studies, yet this practice is little discussed or reported. This issue is the first full-length text devoted to the purpose, practice, and scholarship about this type of formal, structured advice. It includes case studies and analyses of these to answer such basic topics as: What is an evaluation advisory group (EAG)? Why (not) use an EAG? How to organize an EAG, and how to evaluate it? The reader will learn how to view the EAG as a structure of expertise, its use for political legitimacy, and as a response to a variety of constituencies. Guidelines on how to recruit, select, orient, train, monitor, assess, and evaluate EAG members are also included. This is the 136th volume of the Jossey-Bass quarterly report series New Directions for Evaluation, an official publication of the American Evaluation Association.
While the term benchmarking is commonplace nowadays in institutional research and higher education, less common, is a solid understanding of what it really means and how it has been, and can be, used effectively. This volume begins by defining benchmarking as “a strategic and structured approach whereby an organization compares aspects of its processes and/or outcomes to those of another organization or set of organizations to identify opportunities for improvement.” Building on this definition, the chapters provide a brief history of the evolution and emergence of benchmarking in general and in higher education in particular. The authors apply benchmarking to: Enrollment management and student success Institutional effectiveness The potential economic impact of higher education institutions on their host communities. They look at the use of national external survey data in institutional benchmarking and selection of peer institutions, introduce multivariate statistical methodologies for guiding that selection, and consider a novel application of baseball sabermetric methods. The volume offers a solid starting point for those new to benchmarking in higher education and provides examples of current best practices and prospective new directions. This is the 156th volume of this Jossey-Bass series. Always timely and comprehensive, New Directions for Institutional Research provides planners and administrators in all types of academic institutions with guidelines in such areas as resource coordination, information analysis, program evaluation, and institutional management.