
Informing Federal Policies on Evaluation Methodology: Building the Evidence Base for Method Choice in Government Sponsored Evaluations
New Directions for Evaluation, Number 113
Jossey-Bass (Publisher)
Published on 25. July 2007
Book
Paperback/Softback
168 pages
978-0-7879-9734-2 (ISBN)
Description
One of the most divisive issues in the evaluation community has been the debate over which methodologies are to be considered adequate or commendable in addressing different evaluation questions in different settings. One form of this debate involved opposing camps of proponents of qualitative versus quantitative methods. A decade ago, there was some hope that the two sides of this debate, referred to as the paradigm war, were learning to respect each other. More recently, however, a federal agency priority for funding random assignment experimental studies has reignited the debate. This volume provides a space for a productive dialogue that, by identifying areas of agreement but also fundamental differences, will promote a more durable working consensus on the circumstances in which some methods are to be preferred over others. The chapter authors and discussants make clear that there are different types of evidence with which to inform this dialogue, including empirical findings of the impact of method choice on evaluation outcomes, the evidence contained in the wisdom of practice, and the results of critical analyses of the broader social impacts of method choice. The editors build on these contributions to suggest pragmatic policies for federal agencies, promoting both context-appropriate method choice and the importance of managing portfolios of evaluative research that maintain desired distributions of methodologies.
This is the 113th volume of the Jossey-Bass quarterly report series New Directions for Evaluation, a publication of Jossey-Bass and the American Evaluation Association.
This is the 113th volume of the Jossey-Bass quarterly report series New Directions for Evaluation, a publication of Jossey-Bass and the American Evaluation Association.
More details
Series
Language
English
Place of publication
New York
United States
Publishing group
John Wiley & Sons Inc
Target group
Professional and scholarly
Dimensions
Height: 229 mm
Width: 152 mm
Thickness: 9 mm
Weight
227 gr
ISBN-13
978-0-7879-9734-2 (9780787997342)
Copyright in bibliographic data and cover images is held by Nielsen Book Services Limited or by the publishers or by their respective licensors: all rights reserved.
Schweitzer Classification
Persons
George Julnes is associate professor of psychology at Utah State University. He has been a proponent of multiple methods for policy evaluation and is directing a random assignment evaluation of disability policy reform that makes extensive use of participant interviews and focus groups.
Debra J. Rog coauthored this chapter while serving as senior research assoociate with the center for Evaluation and Program Improvement and director of its Washington office. She is currently an associate area director with Westat and a vice president of the Rockville Institute.
Debra J. Rog coauthored this chapter while serving as senior research assoociate with the center for Evaluation and Program Improvement and director of its Washington office. She is currently an associate area director with Westat and a vice president of the Rockville Institute.