Brown University

Using a Text-as-Data Approach to Understand Reform Processes: A Deep Exploration of School Improvement Strategies

Description

Abstract:
Although program evaluations using rigorous quasi-experimental or experimental designs can inform decisions about whether to continue or terminate a given program, they often have limited ability to reveal the mechanisms by which complex interventions achieve their effects. To illuminate these mechanisms, this paper analyzes novel text data from thousands of school improvement planning and implementation reports from Washington State, deploying computer-assisted techniques to extract measures of school improvement processes. Our analysis identified 15 coherent reform strategies that varied greatly across schools and over time. The prevalence of identified reform strategies was largely consistent with school leaders’ own perceptions of reform priorities via interviews. Several reform strategies measures were significantly associated with reductions in student chronic absenteeism and improvements in student achievement. We lastly discuss the opportunities and pitfalls of using novel text data to study reform processes.

Access Conditions

Use and Reproduction
In Copyright

Citation

Min Sun, Jing Liu, Junmeng Zhu, et al., "Using a Text-as-Data Approach to Understand Reform Processes: A Deep Exploration of School Improvement Strategies" (2019). EdWorkingPapers.com Archive. Brown Digital Repository. Brown University Library. https://repository.library.brown.edu/studio/item/bdr:956637/

Relations

Collection:

  • EdWorkingPapers.com Archive

    The Annenberg Institute at Brown University has developed this national working paper series to provide public access to high-quality papers from multiple disciplines on a wide variety of topics related to education. EdWorkingPapers focuses particularly on research with strong implications …
    ...