Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Replication issues in social experiments: lessons from US labor market programs

Replication issues in social experiments: lessons from US labor market programs When evaluating a pilot or demonstration program, there are risks from drawing inferences from a single test. This paper reviews the experiences of replication efforts from demonstrations using randomized controlled trials in the initial evaluation and the replications. Although replications of promising programs are primarily gathered to increase sample size, replications are also used to learn if the intervention is successful for other target groups and geographic locations, and to vary some of the intervention’s features. In many cases, replications fail to achieve the same success as the original evaluation, and the paper reviews reasons that have been suggested for such failures. The paper reviews what has been learned from replications where random assignment was used in six instances: income maintenance experiments, unemployment insurance bonus experiments, the Center for Employment Training program, job clubs, job search experiments, and the Quantum Opportunity Program. The paper concludes by summarizing lessons learned from the review and areas where more research is needed. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Journal for Labour Market Research Springer Journals

Replication issues in social experiments: lessons from US labor market programs

Download PDF
14 pages

Loading next page...
 
/lp/springer-journals/replication-issues-in-social-experiments-lessons-from-us-labor-market-MB12pbFG0K
Publisher
Springer Journals
Copyright
Copyright © 2013 by Institut für Arbeitsmarkt- und Berufsforschung
Subject
Economics / Management Science; Labor Economics; Sociology, general; Human Resource Management; Economic Policy; Regional/Spatial Science; Population Economics
ISSN
1614-3485
eISSN
1867-8343
DOI
10.1007/s12651-013-0133-2
Publisher site
See Article on Publisher Site

Abstract

When evaluating a pilot or demonstration program, there are risks from drawing inferences from a single test. This paper reviews the experiences of replication efforts from demonstrations using randomized controlled trials in the initial evaluation and the replications. Although replications of promising programs are primarily gathered to increase sample size, replications are also used to learn if the intervention is successful for other target groups and geographic locations, and to vary some of the intervention’s features. In many cases, replications fail to achieve the same success as the original evaluation, and the paper reviews reasons that have been suggested for such failures. The paper reviews what has been learned from replications where random assignment was used in six instances: income maintenance experiments, unemployment insurance bonus experiments, the Center for Employment Training program, job clubs, job search experiments, and the Quantum Opportunity Program. The paper concludes by summarizing lessons learned from the review and areas where more research is needed.

Journal

Journal for Labour Market Research – Springer Journals

Published: Jul 5, 2013

References

  • Do unemployment insurance recipients actively seek work? Evidence from randomized trials in four US states
    Ashenfelter, O.; Ashmore, D.; Olivier, D.
  • Job-finding club: a group-assisted program for finding employment
    Azrin, N.H.; Flores, T.; Kaplan, S.J.
  • The job club method for the handicapped: a comparative outcome study
    Azrin, N.H.; Philip, R.A.
  • Comparative evaluation of the job club program with welfare recipients
    Azrin, N.H.; Philip, R.A.; Thienes-Hontos, P.; Besalel, V.A.
  • Anemia and school participation
    Bobonis, G.J.; Miguel, E.; Charma, C.P.
  • Lessons from Income Maintenance Experiments
    Burtless, G.
  • Jobstart: Final Report on Program for School Dropouts
    Cave, G.; Bos, H.; Doolittle, F.; Toussaint, C.
  • Reemployment Bonuses in the Unemployment Insurance System: Evidence from Three Field Experiments
    Corson, W.A.; Spiegelman, R.G.
  • Reemployment Bonuses in the Unemployment Insurance System: Evidence from Three Field Experiments
    Corson, W.A.; Spiegelman, R.G.
  • Social Experimentation and Public Policymaking
    Greenberg, D.; Linksz, D.; Mandell, M.
  • Evaluation of the Quantum Opportunities Program: Did the Program Work?
    Hahn, A.; Leavitt, T.; Aaron, P.
  • New Evidence About Effective Training Strategies
    Hollister, R.
  • The illusion of sustainability
    Kremer, M.; Miguel, E.
  • Summary and Findings of the National Supported Work Demonstration
  • The Quantum Opportunity Program Demonstration: Implementation and Short-Term Impacts
    Maxfield, M.; Schirm, A.; Rodriguez-Planas, N.
  • Lessons from the US unemployment insurance experiments
    Meyer, B.D.
  • Worms: identifying impacts on education and health in the presence of treatment externalities
    Miguel, E.; Kremer, M.
  • Working with Disadvantaged Youth: Thirty-Month Findings from the Center for Employment Training Replication Sites
    Miller, C.; Bos, J.M.; Porter, K.E.; Tseng, F.M.; Doolittle, F.C.; Tanguay, D.N.; Vencil, M.P.
  • The Challenge of Repeating Success in a Changing World: Final Report on the Center for Employment Training Replication Sites
    Miller, C.; Bos, J.M.; Porter, K.E.; Tseng, F.M.; Abe, Y.
  • Does Training for the Disadvantaged Work? Evidence from the National JTPA Study
    Orr, L.L.; Bloom, H.S.; Bell, S.H.; Doolittle, F.; Lin, W.; Cave, G.
  • Reemployment Bonuses in the Unemployment Insurance System: Evidence from Three Field Experiments
  • Solving the Reemployment Puzzle
    Wandner, S.A.
  • Job Search Strategies: Lessons from the Louisville WIN Laboratory
    Wolfhagen, C.; Goldman, B.S.
  • Bonuses to workers and employers to reduce unemployment: randomized trials in Illinois
    Woodbury, S.A.; Spiegelman, R.G.