H. Van den Bergh
5 articles-
How Prior Information from National Assessments can be used when Designing Experimental Studies without a Control Group ↗
Abstract
National assessments yield a description of the proficiency level in a domain while accounting for differences between tasks. For instance, in writing assessments the level of proficiency is typically evaluated with a variety of topics and multiple tasks. This enables generalizations from specific tasks to a domain. In (quasi-)experimental research, however, writing skills are often evaluated with a single task. Yet, conclusions about the effectiveness of the treatment are formulated on the level of the domain, which is, euphemistically put, quite a stretch. Although conclusions drawn about the effect of the treatment are specific to the task administered, they are often generalized to the domain without any form of reservation. This raises the question whether we can use the results of national assessments about differences between tasks in the analyses of experimental studies. In this paper, we demonstrate how the information of a baseline data set can be used as a kind of control condition in the analysis of an experimental study.
-
Refocusing education in writing style? Relationships between stylistic lapses and the quality of Dutch secondary school students’ argumentative writing ↗
Abstract
In Dutch L1 classrooms, style in non-fictional genres is typically taught by means of normative exercises in which students are tasked to identify stylistic lapses. Not much is known about the effectiveness of such exercises when teaching style. Unknown factors include what kinds of stylistic shortcomings are found in Dutch students’ writing, and how the occurrence of certain stylistic lapses relates to writing quality. The current study empirically explores these scarcely investigated issues. Teachers rated 125 argumentative texts written by tenth-grade pre-university students by means of comparative judgement. Additionally, these texts were manually analyzed to investigate the occurrence of stylistic lapses, taking into account stylistic lapses that are common in text books (‘standard category’) and other types of style related errors (‘other category’). Multilevel regression analyses revealed that only one of the stylistic lapses from the standard category negatively influenced text quality as evaluated by teachers, namely the use of detached phrases. In the other category, only mistakes in question marks negatively predicted text quality. A final model including those two predictors explained 11.1% of the variance in text quality. The article discusses the implications of these findings for non-fictional style education, suggesting that it might need to be refocused.
-
Effects of hypertext writing and observational learning on content knowledge acquisition, self-efficacy, and text quality: Two experimental studies exploring aptitude treatment interactions. ↗
Abstract
In two experimental studies, we examined the effects of types of written production mode (hypertext writing versus linear writing, Study 1 and 2) and learning mode (performance versus observational learning, Study 2). Participants in Study 1 (Grade 10) were initiating the more formal academic argumentative text, while in Study 2 students (Grade 11) were familiar with the genre. Dependent variables were students’ content knowledge, self-efficacy for writing and text quality. For the independent variable written production mode both studies did show interaction effects between learning condition and pretest scores. For content knowledge, students with lower prior content knowledge performed best in the hypertext condition; students with higher prior content knowledge in the linear condition. For self-efficacy, linear writing was most effective for students with initial high self-efficacy (Study 2 only). For text quality, students with relatively very strong initial writing skills performed best in the hypertext condition, students with weak initial writing skills in the linear condition (Study 2 only). For the independent variable learning mode for the hypertext text learning activity (performing versus observing), almost no differences in effects could be observed: performing the hypertext learning activities or observing these performances did not make a difference, except to students with relatively low initial topic knowledge: students with low prior knowledge performed better in the performing condition. These complex patterns of interactions between learning conditions and pretest variables are discussed.
-
Abstract
This study examined the effects of an innovative comprehensive writing program in upper primary education on students’ writing performance and on teachers´ classroom practices, beliefs and skills. The program focused on the communicative nature of writing, on writing as a process, and on explicit teaching of five genre-specific writing strategies. It was implemented by 43 teachers in their regular classrooms (Grades 4 to 6, N = 1052), with three conditions: (1) a writing program condition, (2) the same program complemented by professional development sessions and coaching, and (3) a control condition in which teachers taught their usual writing lessons. Students’ writing performance was measured three times with multiple writing tasks. Data on teachers’ practices, beliefs and skills were collected through lesson observations, interviews, questionnaires, teacher logs, and a text assessment task. The comprehensive writing program had a beneficial effect on students’ writing performance and the extent to which teachers taught writing strategies. The complementary professional development and coaching had a direct effect on the number of lessons implemented, and an indirect effect on students' performance. Overall, the innovation proved to be effective for improving students’ writing performance in the upper grades of primary schools.
-
Abstract
It has been established that in the Netherlands, as in other countries, a majority of students do not attain the desired level of writing skills at the end of elementary school. Time devoted to writing is limited, and only a minority of schools succeed in effectively teaching writing. An improvement in the way writing is taught in elementary school is clearly required. In order to identify effective instructional practices we conducted a meta-analysis of writing intervention studies aimed at grade 4 to 6 in a regular school setting. Average effect sizes were calculated for ten intervention categories: strategy instruction, text structure instruction, pre-writing activities, peer assistance, grammar instruction, feedback, evaluation, process approach, goal setting, and revision. Five of these categories yielded statistically significant results. Pairwise comparison of these categories revealed that goal setting (ES = 2.03) is the most effective intervention to improve students’ writing performance, followed by strategy instruction (ES = .96), text structure instruction (ES = .76), peer assistance (ES = .59), and feedback (ES = .88) respectively. Further research is needed to examine how these interventions can be implemented effectively in classrooms to improve elementary students’ writing performance.