How Prior Information from National Assessments can be used when Designing Experimental Studies without a Control Group
Abstract
National assessments yield a description of the proficiency level in a domain while accounting for differences between tasks. For instance, in writing assessments the level of proficiency is typically evaluated with a variety of topics and multiple tasks. This enables generalizations from specific tasks to a domain. In (quasi-)experimental research, however, writing skills are often evaluated with a single task. Yet, conclusions about the effectiveness of the treatment are formulated on the level of the domain, which is, euphemistically put, quite a stretch. Although conclusions drawn about the effect of the treatment are specific to the task administered, they are often generalized to the domain without any form of reservation. This raises the question whether we can use the results of national assessments about differences between tasks in the analyses of experimental studies. In this paper, we demonstrate how the information of a baseline data set can be used as a kind of control condition in the analysis of an experimental study.
- Journal
- Journal of Writing Research
- Published
- 2023-02-01
- DOI
- 10.17239/jowr-2023.14.03.05
- CompPile
- Open Access
- OA PDF Diamond
- Topics
- Export
- BibTeX RIS
Citation Context
Cited by in this index (0)
No articles in this index cite this work.
References (0)
No references on file for this article.
Related Articles
-
Written Communication May 2026Beyond Co-Regulation: Interplay as a Methodological Framework for Examining Self-Regulation in Generative AI-Assisted Writing ↗Ryan Roderick; Susan Tanner
-
Journal of Response to Writing Apr 2026Mehrzad, Mohaddeseh; Rahimi, Mohammad; Link, Stephanie
-
Written Communication Mar 2026Matthew Overstreet; Silvia Vaccino-Salvadore; Diana Akhmedjanova
-
Written Communication Jan 2026Zhijun Gao; Lin Dong; Jiangying Wang
-
Pedagogy Jan 2026Krysten Stein; Kishonna Gray