Program Evaluation and Performance Measurement

Chapter 1: Key Concepts and Issues in Program Evaluation and Performance Management
Introduction
Policies and Programs
Key Concepts in Program Evaluation
Example: Evaluating a Police Body-Worn Camera Program in Rialto, California
Ten Key Evaluation Questions
The Steps in Conducting a Program Evaluation
Summary
Discussion Questions
References
Chapter 2: Understanding and Applying Program Logic Models
A Basic Logic Modeling Approach
Working with Uncertainty
Program Objectives, and Program Alignment with Government Goals
Program Theories and Program Logics
Logic Models that Categorize and Specify Intended Causal Linkages
Constructing a Logic Model for Program Evaluation
Logic Models for Performance Measurement
Strengths and Limitations of Logic Models
Summary
Discussion Questions
Appendices
References
Chapter 3: Research Designs for Program Evaluations
Introduction
Our Stance
What is Research Design?
Why Pay Attention to Experimental Design?
Using Experimental Designs to Evaluate Programs
Defining and Working with the Four Basic Kinds of Threats to Validity
Quasi-Experimental Designs: Navigating Threats to Internal Validity
Non-Experimental Deisgns
Testing the Causal Linkages in Program Logic Models
Research Designs and Performance Measurement
Summary
Discussion Questions
Appendices
References
Chapter 4: Measurement for Program Evaluation and Performance Monitoring
Introduction
Introducing Reliability and Validity of Measures
Units of Analysis and Levels of Measurement
Sources of Data in Program Evaluations and Performance Measurement Systems
Using Surveys to Estimate the Incremental Effects of Programs
Survey Designs Are Not Research Designs
Validity of Measures, and the Validity of Causes and Effects
Summary
Discussion Questions
References
Chapter 5: Applying Quantitative Evaluation Methods
Introduction
Comparing and Contrasting Different Approaches to Qualitative Evaluations
Qualitative Evaluations Designs: Some Basics
Designing and Conducting Qualitative Program Evaluations
Assessing the Credibility and Generalizability of Qualitative Findings
Connecting the Qualitative Evaluation Methods to Performance Measurement
The Power of Case Studies
Summary
Discussion Questions
References
Chapter 6: Needs Assessments for Program Development and Adjustment
Introduction
Steps in Conducting Needs Assessments
Needs Assessment Example: Community Health Needs Assessment in New Brunswick
Summary
Discussion Questions
Appendices
References
Chapter 7: Concepts and Issues in Economic Evaluation
Introduction
Three Types of Economic Evaluation
Economic Evaluation in the Performance Management Cycle
Historical Developments in Economic Evaluation
Cost-Benefit Analysis
Cost-Efective Analysis
Cost-Utility Analysis
Cost-Benefit Analysis Example: The High/Scope Perry Preschool Program
Strengths and Limitations of Economic Evaluation
Summary
Discussion Questions
References
Chapter 8: Performance Measurement as an Approach to Evaluation
Introduction
The Current Imperative to Measure Performance
Performance Measurement for Accountability and Performance Improvement
Growth and Evolution of Performance Measurement
Metaphors that Support and Sustain Performance Measurement
Comparing Program Evaluation and Performance Measurement Systems
Summary
Discussion Questions
References
Chapter 9: Design and Implementation of Performance Measurement Systems
Introduction
The Technical/Rational View and the Political/Cultural View
Key Steps in Designing and Implementing A Performance Measurement System
Performance Measurement for Public Accountability
Summary
Discussion Questions
Appendix A: Organizational Logic Models
References
Chapter 10: Using Performance Measurement for Accountability and Performance Improvement
Introduction
Using Performance Measures
Rebalancing Accountability-Focused Performance Measurement Systems to Increase Performance Improvement Uses
When Performance Measurement Systems De-Emphasize Outputs and Outcomes: Performance Management Under Conditions of Chronic Fiscal Restraint
Summary
Discussion Questions
References
Chapter 11: Program Evaluation and Program Management: Joining Theory and Practice
Introduction
Internal Evaluation: Views from the Field
Building an Evaluative Culture in Organizations: An Expanded Role for Evaluators
Striving for Objectivity in Program Evaluations
Criteria for High-Quality Evaluations
Summary
Discussion Questions
References
Chapter 12: The Nature and Practice of Professional Judgement in Program Evaluation
Introduction
The Nature of the Evaluation Enterprise
Ethical Foundations of Evaluation Practice
Ethical Guidelines for Evaluation Practice
Understanding Professional Judgement
Improving Professional Judgement in Evaluation
The Prospects for an Evaluation Profession
Summary
Discussion Questions
Appendix
References