Evaluation in Today's World

Preface About the Authors Acknowledgments Chapter 1 Evaluations of Future: Inclusive, Equity-Focused, Useful, and Used Introduction An Overview of the Book An Overview of Evaluation Race, Racism, Social Justice, and a Racialized Perspective Objectivity and Bias Culture, Cultural Competence, and Cultural Responsiveness The Impact of Politics The Current Climate Chapter 2 Evaluation Ethics and Quality Standards Introduction A Brief Historical Perspective on Research Ethics Ethics in Evaluation Cultural Competence as an Ethical Imperative Ethical Sensitivity and Dilemmas Ethical Challenges and Dilemmas Across the Evaluation Process Ethical Principles and Standards for Evaluators and Evaluations Evaluation Corruptibility and Fallacies Evaluator Role, Power, Politics, and Ethics Interplay of Politics and Ethics Chapter 3 Historical Evolution of Program Evaluation Through a Social Justice Lens Introduction History of Evaluation Through a Social Justice Lens Evaluation Prior to Modern Times of the 20th Century Overview of Evaluation in the 20th Century Hidden Figures and Histories in Early-20th-Century Evaluation Evaluation in 1960-2000 Rethinking the Role of Evaluation Influential Women in Evaluation: 1970s-1990s Influential 20th-Century Evaluator: An Activity 21st-Century Evaluation: Expanding the Focus Chapter 4 Evaluation Paradigms, Theories, and Models Introduction The Value of Scientific Paradigms and Theories in Evaluation Social Science Paradigms and Theories Program Theory of Change Evaluation Theories, Models, and Approaches Distinguishing Evaluation Theories, Models, and Approaches Classifying Evaluation Approaches and Theories Evaluation Theories Within a Cultural Context Evaluation Approaches and Theories: A Summary Description of Selected Examples Chapter 5 Social Justice and Evaluation: Theories, Challenges, Frameworks, and Paradigms Introduction Social Justice Marginalized Groups Theories Providing Context for Social Justice Evaluations Race, Racism, and Evaluation Challenges to Social Justice and Evaluation Efforts to Reduce the Impact of Racism on Evaluation Evaluation Models and Social Justice Social Justice-Oriented Evaluation Frameworks and Paradigms Chapter 6 Evaluation Types With a Cultural and Racial Equity Lens Introduction Classifying Evaluations Different Types of Evaluations Developmental Evaluations: Another Alternative to Formative-Summative Putting It All Together Chapter 7 Social Programming, Social Justice, and Evaluation Introduction Understanding Social Problems and Social Programs Through a Social Justice Lens Structural Racism, Social Programming, and Evaluation Integrating Program Planning and Evaluation Planning Social Program Evaluations vs. Social Project Evaluations: Distinctions and Implications Key Program/Project Components Every Evaluator Must Understand Logic Models: Linking Program Components Logic Models and Evaluation Planning Beyond Traditional Linear Logic Models Chapter 8 Responsive Stakeholder Engagement and Democratization of the Evaluation Process Introduction Who Are Stakeholders? Valuing Stakeholders and Diverse Stakeholder Engagement Identifying and Classifying the Right Stakeholders Democratizing the Evaluation Process With Stakeholders Relationships, Values, and Stakeholder Engagement Responsive Stakeholder Engagement Continuum of Stakeholder Engagement: From Nonresponsive to Responsive Barriers to Responsive Stakeholder Engagement Benefits of Responsive Stakeholder Engagement Six-Step Process for Responsive Stakeholder Engagement Communicating With Stakeholders Chapter 9 Planning the Evaluation Introduction Dealing With Power Imbalances During Evaluation Planning Planning for Culturally Responsive and Social Justice-Oriented Evaluations Evaluation Planning Activities Identifying and Involving Stakeholders in Evaluation Planning Analysis of the Context Identifying and Clarifying Project Goals Identifying the Purpose(s) of the Evaluation Defining Success in Evaluation Planning Developing Timelines Identifying Resource Needs Assembling an Evaluation Team Evaluation Planning and Management Visualization Tools Developing a Written Evaluation Plan Overcoming Pitfalls in Evaluation Planning Chapter 10 Evaluation Questions That Matter Introduction Why Evaluation Questions That Matter? Power and Privilege Issues in Formulating Evaluation Questions Characteristics of Good Evaluation Questions: An Overview Sources of Evaluation Questions Prioritizing Evaluation Questions for Diverse Audiences Inclusion/Exclusion Criteria for Prioritizing Evaluation Questions: Two Approaches Steps to Identifying, Formulating, and Prioritizing Questions That Matter Types of Evaluation Questions Summary of Different Types of Evaluation Questions Chapter 11 Selecting Appropriate Evaluation Designs Introduction Rigor Control and Comparison Groups Longitudinal Data Evaluation Designs Rival Hypotheses and Threats to Validity The Best Design for the Question Chapter 12 Defining, Collecting, and Managing Data Introduction Qualitative and Quantitative Data Strengths and Weaknesses of Qualitative and Quantitative Data Ensuring Data Quality Protection of Human Participants Using Existing Measures or Developing New Ones Modes of Data Collection Data Management Chapter 13 The Best Analysis for the Data Introduction Deductive and Inductive Reasoning Quantitative Analysis Qualitative Analysis Chapter 14 Reporting, Disseminating, and Utilizing Evaluation Results Introduction Reporting Results Developing High-Quality, Accessible Reports and Presentations Visually Representing Data Dissemination Using Evaluation Results Chapter 15 Evaluation as a Business Introduction Perspectives on Doing Evaluation as a Business Ethics Business Knowledge and Skills Contracts Making a Business Financially Viable Selecting a Business Entity Developing a Business Plan Chapter 16 Interconnections and Practical Implications Introduction Objectivity and Bias Building Cultural Competence Personalizing a Social Justice Perspective Reflective Practice and Evaluative Thinking Applying to Practice Social Justice Evaluation Politics and Evaluation Voices From the Field: Advice for New Evaluators A Final Thought Supplemental Resources Appendix A Appendix B Glossary References