Exploring the Long-Term Effects of the Statewide Implementation of an Automated Writing Evaluation System on Students' State Test ELA Performance
Huang, Y., Wilson, J., & May, H. (2024). Exploring the long-term effects of the statewide implementation of an automated writing evaluation system on students' state test ELA performance. International Journal of Artificial Intelligence in Education. https://doi.org/10.1007/s40593-024-00443-9
This article examines the long-term effects of statewide implementation of Utah Compose, an automated writing evaluation system, on Grades 4-10 students' state English Language Arts performance in Utah using a quasi-experimental inverse probability of treatment weighting design.
Key takeaways
- Statewide AWE implementation was associated with cumulative gains in students' ELA performance.
- The positive effects appeared to decrease over time and peaked after about three years of implementation.
- The study provides a large-scale evaluation of AWE effects on a distal state-level outcome.
Why it matters
Offers one of the largest longitudinal evaluations of an automated writing evaluation system, estimating its cumulative impact on state ELA test performance across multiple years of statewide use.
Coauthors
Yue Huang, Joshua Wilson, Henry May
Topic tags
External links