How Prior Information from National Assessments can be used when Designing Experimental Studies without a Control Group
Abstract
National assessments yield a description of the proficiency level in a domain while accounting for differences between tasks. For instance, in writing assessments the level of proficiency is typically evaluated with a variety of topics and multiple tasks. This enables generalizations from specific tasks to a domain. In (quasi-)experimental research, however, writing skills are often evaluated with a single task. Yet, conclusions about the effectiveness of the treatment are formulated on the level of the domain, which is, euphemistically put, quite a stretch. Although conclusions drawn about the effect of the treatment are specific to the task administered, they are often generalized to the domain without any form of reservation. This raises the question whether we can use the results of national assessments about differences between tasks in the analyses of experimental studies. In this paper, we demonstrate how the information of a baseline data set can be used as a kind of control condition in the analysis of an experimental study.
- Journal
- Journal of Writing Research
- Published
- 2023-02-01
- DOI
- 10.17239/jowr-2023.14.03.05
- CompPile
- Search in CompPile ↗
- Open Access
- OA PDF Diamond
- Topics
- Export
- BibTeX RIS
Citation Context
Cited by in this index (0)
No articles in this index cite this work.
Cites in this index (0)
No references match articles in this index.
Related Articles
-
Written Communication Mar 2026Matthew Overstreet; Silvia Vaccino-Salvadore; Diana Akhmedjanova
-
Written Communication Jan 2026Zhijun Gao; Lin Dong; Jiangying Wang
-
Pedagogy Jan 2026Krysten Stein; Kishonna Gray
-
Assessing Writing Jan 2026Generative artificial intelligence for automated essay scoring: Exploring teacher agency through an ecological perspective ↗Jessie S. Barrot
-
Assessing Writing Jan 2026Albert W. Li; Steve Graham