Are We Making a Difference?

Preface - Melanie Greenberg
How Do We Measure Peace?
Whose Peace Are We Measuring?
Introduction - Stacey L. Connaughton and Jasmine R. Linabary
Interrogating "Peacebuilding Effectiveness"
Defining Peacebuilding
Understanding Peacebuilding "Effectiveness"
Our Approach
What is Effectiveness? Effectiveness for Whom?
Lessons Learned
Arguments and Innovations
Conclusion
References
Section I: What is Effectiveness? Effectiveness for Whom?
Chapter 1: The Greatest Myth of Peacebuilding Ineffectiveness - Jason Quinn
Abstract
Tracing the Origins of the Myth
Measuring the Effectiveness of Final Peace Agreements
Full Agreements (Uppsala Conflict Data Program)
AbrogationArmed Conflict RecurrenceComprehensive Peace Agreements (Peace Accord Matrix Project)
AbrogationArmed Conflict RecurrenceKreutz's Conflict Termination Dataset
What Lessons Can We Learn from the Myth of Peace Agreement Ineffectiveness?
Future Directions
Lessons Learned
Reflection Questions
References
Chapter 2: An Ecofeminist Approach to Peacebuilding Effectiveness: An Example from Colombia's Peace Process - Soledad Granada
Effectiveness of Peacebuilding from an Ecofeminist Perspective: Tools and Concepts
Peacebuilding Effectiveness in Colombia from an Ecofeminist Perspective
Social Organization: Intersection of the Social Movement around Peace
Dealing with the Past and Working for the Future: Historical Memory and Legal Activism
Improving Human-Nature Relationships: The Development and Security Nexus
Conclusions
Lessons Learned
Reflection Questions
References
Chapter 3: A Socio-Economic Approach to Reducing Violence Against Women and Girls in Rural Tajikistan - Stuart Moir and Elizabeth Laruni
Abstract
Peacebuilding and SGBV
Living In Dignity: An Effective Approach to Reducing SGBV Committed Within the Family the Project
The Importance of Evidence in Designing an Effective Intervention
The ZS Methodology
The Results
Lessons Learned
Reflection Questions
References
Chapter 4: Whose Peace? Prioritizing Local Perspectives to Inform our Understanding of Peacebuilding Effectiveness - Megan Renoir, Scarlett Kassimatis, Alice Coulibaly, and Dimitri Kotsiras
Abstract
Best Practice in Defining Peacebuilding Effectiveness
Reimagining Peacebuilding Effectiveness
From Peace Writ Little to Peace Writ Large: Foundation Chirezi
Conclusion
Lessons Learned
Reflection Questions
References
Chapter 5: Locally Useful Evidence: Re-Centering Knowledge Creation for Local Peace Work - Michael Sweigart, Kristina Hook, Margarita Tadevosyan, and Susan H. Allen
Abstract
Making Sense of Existing Literature
Methodological Approach
Power Imbalance in Shaping the Peacebuilding Evidence Base
Disconnect Between Donors' Requirements and Local Priorities on Evaluation
Emphasis on the Value of Qualitative Data
Contextual Knowledge and Sensitivity
Promotion of Local Thematic Expertise
Applied Implications for Convening Organizations
Future Research Directions
Lessons Learned
Reflection Questions
References
Chapter 6: Are Peacebuilding Evaluators Making a Difference? Towards a Meta-Evaluative Agenda for Research on Peacebuilding Evaluation - Zach Tilton
Abstract
Background
Key Concepts Defined
Why Meta-Evaluative Research on Peacebuilding Evaluation?
Research on Evaluation Conceptual Frameworks
Toward an Agenda for Research on Peacebuilding Evaluation
Peacebuilding Evaluation Theory
Peacebuilding Evaluation Practice
Peacebuilding Evaluation Consequences
Conclusion
Lessons Learned
Reflection Questions
References
Section II: Lessons Learned
Chapter 7: Illustrating Intended and Unintended Consequences of Peacebuilding in Locally Led Peacebuilding: The Role of Focus Group Methods in Participatory Evaluation - Meghana Rawat and Tiwalade Adekunle
Abstract
Participatory Approaches to Evaluation in Peacebuilding
The Case of the Purdue Peace Project
2016: Pre-Election Focus Groups
Fear of Poverty Due to ViolenceFear of Domestic Despair Due to ViolenceConcern about Illegal Voting and MisinformationConcern about the Changing Sociocultural Fabric of the Community2017: Post-Election Focus Groups
Improvement in Household PeaceImprovement in Election PracticesImprovement in Community RelationshipsConclusion
Lessons Learned
Reflection Questions
References
Chapter 8: Assessing Peacebuilding Effectiveness: The Carter Center in Sudan and Uganda - Michael Papa
Abstract
Objectives of the Principals: TCC, Uganda, and Sudan
Data Analysis
Successes of TCC's Peacebuilding Activities
Restoration of Diplomatic Relations
Trade Relations
Repatriating Abducted Children, Prisoners of War, IDPs, and Refugees
Guinea Worm Disease Eradication
Ending Civil War in Sudan
Failures of TCC's Peacebuilding Activities
Violent Sudanese-Ugandan Offensive Operations against the LRA
Emergence of Civil War in Darfur
Evaluation of Peacebuilding Effectiveness
Lessons Learned
Expectations of Conflicting Parties
Involving All Key Players in Negotiations
International Mediators Teaming up with Locals
Conclusion
Reflection Questions
References
Chapter 9: Post-Conflict Rehabilitation of Ex-Combatants: Assessing Effectiveness of Rehabilitation Programs in Nepal and District Swat, Pakistan, and Nepal - Ilam Khan and Bijaya Dahal
Abstract
Rehabilitation Program in Swat, Pakistan
Sketching Out the Rehabilitation Centers in Swat
Understanding the Process of Rehabilitation
Post-Rehabilitation Assessment
Rehabilitation and Reintegration Program in Nepal
Challenges of Social Integration
Conclusion
Lessons Learned
Reflection Questions
References
Chapter 10: Is Peacebuilding Education Making a Difference? Peace Education Interventions and their Impact in Lebanon - Caroline Brooks, Fadi Hallisso, and Ruth Simpson
Abstract
What Is Peace Education?
Basmeh and Zeitooneh's Approach to Peace Education
Evaluation Techniques
Context Overview
TripoliShatila CampBekkaEvaluation Findings
Evaluation FindingsSustainable Outcomes Are Difficult to Identify Because of the Short Timeframe of Implementation and Limited Longer-Term Follow-up with ParticipantsThere is Some Evidence of the Peacebuilding Impact on the Wider Community, but it is Limited Compared to Individual ImpactCritical Reflections on Peace Education Programming
Lessons Learned
Reflection Questions
References
Chapter 11: Woman, You Are Not Alone! An Effective Approach to Address Violence Against Women - Isabel Aguilar Umaña and Rick Jones
Abstract
The Social Dimensions of VAW
Woman, You Are Not Alone! Women's Self Help Groups Methodology-Evidence
Reduced Physical, Emotional, and Sexual Violence
Well-being
Relationships
Methodologies
Effectiveness
Conclusions
Lessons Learned
Reflection Questions
References
Chapter 12: The Challenges of Assessing Peacebuilding in Pakistan - Zahid Shahab Ahmed and Khan Zeb
Abstract
Theorizing Peacebuilding and Effectiveness
The Need for Peacebuilding in Pakistan
Results and Discussion
The Access Issue
Methodological Issues
Time Limitations
Ethical Dilemmas
Funding
Theory of Change
Conclusion
Lessons Learned
Reflection Questions
References
Chapter 13: Coordination for Effective Peacebuilding: One NGO's Approach - Marcel Arsenault and Conor Seyle
Abstract
What Do We Know about Peacebuilding?
Recognized But Not Materialized
What Can NGO Do about This?
OEF's Model
What Lessons Might There Be for the Larger System?
Lessons Learned
Reflection Questions
References
Chapter 14: Are We Making a Difference or Doing Harm? Practical Strategies for Assessing Peacebuilding Effectiveness to Drive Adaptation and Improvement - Tanya Ansahta Garnett and Camila Linneman
Abstract
What Is the CLA Framework?
How Is the CLA Framework Useful for Evaluating Peacebuilding?
CLA in Action: Case Study Examples
Investing in National Discourse on Post-Conflict Development Priorities in Liberia
Re-Envisioning Who Sets the Development Agenda in Uganda
Rapid, Cost-Friendly, and Collaborative Evaluation Strategies in Liberia
Learning and Adapting to Build Resilience in South Sudan
Infusing "Do No Harm" Principles in Interventions in Liberia
Conclusion
Lessons Learned
Reflection Questions
References
Section III: Arguments and Innovations
Chapter 15: Using Event Data to Address Positive Bias in Evaluations - Steve Sheamer, Alexa Courtney, and Jenna J. Lindeke
Abstract
Data Challenges
Data Availability
Perceptions of Peace Versus Levels of Violence
Proposed Approach
Political Event Data
Methods
Measuring Effectiveness with Political Event DataResults and Discussion
Contextual ApplicationsImplications
1. Program Suitability
2. Geographic Specificity
3. Key Metrics
4. Mixed-Methods
5. Building Evidence
Future Directions
Lessons Learned
Reflection Questions
References
Chapter 16: The Most Significant Change Approach for Evaluating Peace Impacts - Maureen Taylor
Abstract
Background on the Most Significant Change (MSC) Approach
How to Implement MSC
Step 1: Raising Interest and Gaining Buy-in
Step 2: Defining Domains of Change
Step 3: Defining the Reporting Period
Step 4: Collecting MSC Stories
Step 5: Selecting the Most Significant of the Stories
Step 6: Feeding Back the Results of the Selection Process
Step 7: Verification of Stories
Step 8: Quantification
Step 9: Secondary Analysis and Meta-Monitoring
Step 10: Revising the System
Application of MSC to Peacebuilding in Liberia
Lessons Learned and Best Practices
Reflection Questions
References
Chapter 17: The Delphi Method as a Tool in Peacebuilding Assessment - Michael L. Kent
Abstract
History and Background of the Delphi Method
The Delphi Method as a Peacebuilding Tool
Overview of the Delphi Methodology
Repeated Iterations
Selecting Participants
Inviting Participants
Critical Points and Potential Pitfalls
Methodological Complications
Step-by-Step Instructions for Conducting a Delphi Study
Preliminary Preparation
Conclusion
Lessons Learned
Reflection Questions
References
Chapter 18: Participatory Action Research: Mutual Inquiry for Effective Local Peacebuilding - Thomas Hill, Katerina Siira, and Nicole Stoumen
Abstract
The Importance of Participatory Action Research
Locally Led Peacebuilding: Participatory Action Research Case Studies in Libya and Colombia
Libya
Colombia
Conclusion
Lessons Learned
Reflection Questions
References
Chapter 19: Gauging Harmony: Applying the Social Cohesion Barometer to Assess and Advance Peacebuilding - Bob Groelsema and Nell Bolton
Abstract
Social Cohesion as Construct, Aspiration and Lived Reality
Origins and Composition of the Mini-Social Cohesion Barometer
Origins
Composition
Applications of the Barometer
The Barometer as a Baseline and Endline Indicator in CAR
The Barometer as a Tool for Context Analysis in the Lake Chad Basin
Discussion and Lessons
Lessons Learned
Reflection Questions
References
Chapter 20: From Education to Peacebuilding: Exploring the Role of Networks in Peacebuilding Work - Allyson Bachta, Karen Ross, and Jeffrey Pugh
Abstract
What We Know
Our Project
The Potential of Social Networks
Case 1: Regional Institute on Nonviolent Action in the Americas, Ecuador
Case 2: Jewish-Palestinian Encounter Participation, Israel
Conclusions
Lessons Learned
Reflection Questions
References
Chapter 21: To Help Measure Peace, Measure Health - Yara M. Asi
Abstract
Health and Peace
Health and Peace
When Health Becomes a Target: The Case of Syria
Watching a Society Recover: Health in Rwanda
The Benefits of Measuring Peace with Health
Which Health Measures Best Reflect Peace?
Which Health Measures Best Reflect Peace?
Conclusion
Lessons Learned
Reflection Questions
References
Chapter 22: A Global Framework to Measure Peace - Adrienne Lemon
Abstract
Creating Better Evidence on Peace
An Inclusive Way to Understand Impact
A Global Framework for Understanding Peace and Conflict: Three Pillars
Lived Experience
What is this Pillar?Why Does it Matter?Aligned Measures for Peace
What Is This Pillar?Why Does It Matter?Shared Reflection and Adaptation
What Is This Pillar?Why Does It Matter?The Cases: Piloting the Framework
Practitioner Teams: Lessons from Africa, the Middle East, and Central Asia
Setting up Systems: Resources to Make Measuring Peace Accessible
A Vision for Better Evidence
Aligning our Field without Constraining It
Shifting the Paradox of Power and Authority in Peace Measurement
Putting the Global Impact Framework to Use
Lessons Learned
Reflection Questions
References
Conclusion: Peacebuilding Effectiveness: The What, Who, How, and Why It All Matters - Stacey L. Connaughton and Jasmine R. Linabary
Key Reflections: Questions on Peacebuilding Effectiveness
What is "Effectiveness" in Peacebuilding?
Is Effectiveness the Absence of Violence or the Presence of Positive Relations? Both?
Is it about Effectiveness in the Short Term or the Longer Term?
Are We Seeking Program-Level Change or Contributing to Peace Writ Large?
Who Gets to Decide What Effectiveness Means? Who Is It For?
Who Gets to Decide What Effectiveness Means?
Who Is It For?
How Do We Know We Have Achieved Peacebuilding Effectiveness?
What Evidence Has Value?
What is Practical and Ethical to Collect?
Lessons Learned
Embrace a Both/And Mentality on Peacebuilding Effectiveness
Adopt Both Structure and Flexibility When Assessing Peacebuilding Effectiveness
Ask the "Who" Questions and Interrogate Power Dynamics
Limitations and Future Directions
Conclusion
References
Appendix A
Appendix B: Materials shared with IREX Partners at the MSC Workshop
Step 1: Generating the Most Significant Change Stories
Step 2: Selecting and Documenting the Best Stories to Represent Your Organization's Impact
Step 3: Submit the Stories to IREX
Appendix C: Template for Story Submission
Appendix D: Global Impact Framework Diagram
Step 1: Design for Impact
Step 2: Create a Learning Loop
Step 3: Adapt Strategies to Transform Conflict
Step 4: Share and Repeat
Index
About the Editors
About the Contributors