External Validity in Program Evaluation

Paris, France
June 6, 2023

Co-sponsored by the Laboratory for Interdisciplinary Evaluation of Public Policies at Sciences Po and the University of Maryland School of Public Policy.

Conference Agenda

9:30-10:45: Session 1
- Introductions, by Anne Revillard (LIEPP, Sciences Po), Douglas J. Besharov (University of Maryland), Martin Weber (Director of Audit Chamber II, Investments for Cohesion, Growth and Inclusion of the European Court of Auditors), and Bastiaan de Laat (senior evaluator, OECD In-Depth Evaluation Unit).
- “Learning about External Validity from Multiple Literatures” (Jeff Smith, University of Wisconsin)
  paper summary
  
  Discussant: Valérie Pattyn (Leiden University)
10:45-11:00
- Coffe break
11:00-12:30: Session 2
- “Differing Program Environments and Limited Replications Constrain Generalization: The Case of Published Evaluations of School Finance Policies” (Danielle Handel and Eric Hanushek, Stanford University)
  paper summary
  
  Discussant: Priscilla Alamos Concha (Radboud University)
- “Improving the Usefulness and Use of Systematic Reviews and Meta-Analyses to Inform Policy and Practice” (Rebecca Maynard, University of Pennsylvania)
  paper summary
  
  Discussant: Ana Manzano (University of Leeds) (to be confirmed)
12:30-14:00
- Lunch break
14:00-16:30: Session 3
- “The Logic of Generalization from Systematic Reviews to Policy and Practice” (Julia Littell, Bryn Mawr College)
  paper summary
  
  Discussant: Thomas Delahais (Quadrant Conseil)
- “How Mixed-Methods Research Can Improve the Policy Relevance of Impact Evaluations” (Burt Barnow and Sanjay Pandey, George Washington University)
  paper summary
  
  Discussant: Quan-Nha Hong (University of Montreal)
- Does Evidence-Based Policymaking Work for Local Policymakers When Rigorous Impact Evidence Comes from Other Localities? (Larry Orr, Johns Hopkins Bloomberg School of Public Health)
- Concluding remarks, by Tom Ling (European Evaluation Society)
16:30-16:45:
- Coffee break
16:45–17:45:
- Internal work session with authors
Chairs: Doug Besharov (University of Maryland) and Anne Revillard (Sciences Po)
Invited participants: Irene Akua Agyepong (Ghana Health Service), Priscilla Alamos Concha (Radboud University), Burt Barnow (George Washington University), Douglas M. Call (University of Maryland), Bart Cambré (Antwerp Management School), Thomas Delahais (Quadrant Conseil), Sergi Fàbregues (Catalunya Open University), Bui Thi Thu Ha (Hanoi University of Public health), Danielle Handel (Stanford University), Eric Hanushek (Stanford University), Quan-Nha Hong (University of Montreal), Sumit Kane (University of Melbourne), Julia Littell (Bryn Mawr College), Ana Manzano (University of Leeds), Rebecca Maynard (University of Pennsylvania), Tolib Mirzoev (London School of Hygiene and Tropical Medicine), Sanjay Pandey (George Washington University), Valérie Pattyn (Leiden University), Valéry Ridde (Université Paris Cité, IRD), Benoît Rihoux (Université catholique de Louvain), Jeff Smith (University of Wisconsin), Geoff Wong (Oxford University)

Click here to register to attend on site.
Click here to register to attend online.