Abstract

Students are usually expected to write full texts in English as a foreign language (EFL) at the end of secondary education. However, research on EFL writing at school is scarce, especially regarding less proficient writers, and seldom focuses on deep-level text features such as structure and coherence. Based on a sample of 166 EFL students in Year 9 attending German middle and lower performance track schools, this study examined 326 narrative and argumentative texts. First, we assessed structure and coherence via analytic ratings using detailed rubrics to gain insights into possible challenges for students. Our analysis showed that relevant text parts (such as the conclusion) were mostly missing and that students struggled to establish a broad common thread with argumentative texts being overall less structured and coherent than narrative texts. Second, we used the software Comproved® to conduct holistic ratings of overall text quality and compared them with our analytic ratings. Large correlations between both ratings suggest that structure and coherence are important aspects of text quality. We discuss how our rubrics can serve as a useful tool for assessment for learning and assist less proficient writers in establishing deep-level features in their texts.

Journal
Assessing Writing
Published
2022-10-01
DOI
10.1016/j.asw.2022.100672
CompPile
Open Access
OA PDF Hybrid
Topics
Export

Citation Context

References (68) · 8 in this index

  1. Alderson, J.C. (2005). Diagnosing foreign language proficiency: The interface between learning and assessment…
  2. Using rubrics to promote thinking and learning
    Educational Leadership
  3. Considering what we know and need to know about second language writing
    Applied Linguistics Review  
  4. Comparing narrative and expository text construction across adolescence: A developmental …
    Discourse Processes  
  5. Developing the theory of formative assessment
    Educational Assessment, Evaluation and Accountability  
Show all 68 →
  1. The quality and effectiveness of descriptive rubrics
    Educational Review  
  2. Introduction: Views of coherence
    Coherence in spoken and written discourse: How to create it and how to describe it. Selected papers from the international workshop on coherence, Augsburg
  3. Wirksame Schreibförderung durch diversitätssensibles formatives Feedback [Effective writi…
  4. Statistical power analysis for the behavioral sciences
  5. Common European framework of reference for languages: Learning, teaching, assessment. Companion volume
  6. Cohesion, coherence, and expert evaluations of writing proficiency
    Proceedings of the Annual Meeting of the Cognitive Science Society
  7. Teaching and learning the writing of persuasive/argumentative discourse
    Canadian Journal of Education  
  8. Culham, R. (2003). 6+1 traits of writing: The complete guide – grades 3 and up. Scholastic Professional Books.
  9. Theoretical perspectives on writing
    Annual Review of Applied Linguistics  
  10. Institutionalised foreign language learning: Teaching English at different levels. In C. …
    Teaching English as a foreign language: An introduction
  11. College Composition and Communication
  12. Assessing Writing
  13. How to obtain efficient high reliabilities in assessing texts: Rubrics vs comparative judgement
    Communications in computer and information science: Technology enhanced assessment  
  14. Comparing and combining different approaches to the assessment of text quality
    Methods in writing process research
  15. Evidence-based writing practices: A meta-analysis of existing meta-analyses
    Design principles for teaching effective writing
  16. Formative assessment and writing
    The Elementary School Journal  
  17. Graham, S. & Perin, D. (2007). Writing next: Effective strategies to improve writing of adolescents in middle…
  18. Cognitive ability influences on written expression: Evidence for developmental and sex-ba…
    Journal of School Psychology  
  19. Cohesion in English
  20. Schreibfähigkeit [Writing abilities]. In B. Beck & E. Klieme (Hrsg.)
    Sprachliche Kompetenzen: Konzepte und Messung - DESI-Studie (Deutsch Englisch Schülerleistungen International) [Language Competencies: Concepts and Measurement - DESI Study (German English Student Achievement International)]
  21. Schreiben Englisch [Writing in English]. In E. Klieme (Hrsg.)
    Unterricht und Kompetenzerwerb in Deutsch und Englisch: Ergebnisse der DESI-Studie [Instruction and competence assessment in German and English: Results of the DESI study]
  22. The power of feedback
    Review of Educational Research  
  23. Students’ argumentative writing skills in science and first-language education: Commonali…
    International Journal of Science Education  
  24. Heller, K.A. & Perleth, C. (2000). KFT 4–12+R: Kognitiver Fähigkeitstest für 4. bis 12. Klassen, Revision [KF…
  25. What research on second language writing tells us and what it doesn’t
    ESL & applied linguistics professional series: Handbook of research in second language teaching and learning
  26. Judgment accuracy in experienced versus student teachers: Assessing essays in English as …
    Teaching and Teacher Education  
  27. Assessing Writing
  28. An alternative approach to assessing achievement
    Proceedings of the 40th Conference of the International Group for the Psychology of Mathematics Education
  29. Crossed random-effect modeling: Examining the effects of teacher experience and rubric us…
    Eurasian Journal of Educational Research  
  30. English writing skills of students in upper secondary education: Results from an empirica…
    Journal of Second Language Writing  
  31. KMK] The Standing Conference of the Ministers of Education and Cultural Affairs of the Länder in the Federal …
  32. KMK] The Standing Conference of the Ministers of Education and Cultural Affairs of the Länder in the Federal …
  33. Diagnostic assessment of writing: A comparison of two rating scales
    Language Testing  
  34. Assessing Writing
  35. Schreibkompetenzen im Fach Englisch in der gymnasialen Oberstufe [Writing competence in E…
    Zeitschrift für Erziehungswissenschaft  
  36. Assessing the quality of argumentative texts: Examining the general agreement between dif…
    Frontiers in Education  
  37. Automated scoring of junior and senior high essays using Coh-Metrix features: Implication…
    Language Testing  
  38. EFL writing in schools
    Handbooks of applied linguistics: Handbook of second and foreign language writing
  39. The development of feedback literacy for writing teachers
    TESOL Quarterly  
  40. Comparative judgement as a promising alternative to score competences
    Advances in higher education and professional development: Innovative practices for higher education assessment and measurement  
  41. Studienbuch Linguistik [Linguistics study guide]
  42. Mind the gap! Students’ use of exemplars and detailed rubrics as formative assessment
    Instructional Science  
  43. Insights from instructional research on revision with struggling writers. In G. Rijlaarsd…
    Studies in writing: Revision cognitive and instructional processes  
  44. Automated evaluation of text and discourse with Coh-Metrix
  45. Ministerium für Schule, Jugend und Kinder des Landes NRW (Ed.)
    Kernlehrplan für die Gesamtschule - Sekundarstufe I in Nordrhein-Westfalen: Englisch [Curriculum for Gesamtschule in North Rhine-Westphalia: English]
  46. Ministerium für Schule, Jugend und Kinder des Landes NRW (Ed.)
    Kernlehrplan für die Realschule in Nordrhein-Westfalen: Englisch [Curriculum for Realschule in North Rhine-Westphalia: English]
  47. Ministerium für Schule, Jugend und Kinder des Landes NRW (Ed.)
    Kernlehrplan für die Hauptschule in Nordrhein-Westfalen: Englisch [Curriculum for Hauptschule in North Rhine-Westphalia: English]
  48. Individuelle Förderung: Heterogenität und Handlungsperspektiven in der Schule [Individual support: Heterogeneity and perspectives for action in schools]
  49. Teaching writing to children who are underserved
    Journal of Educational Psychology  
  50. Niedersächsisches Kultusministerium (Ed.). (2015). Kerncurriculum für die Integrierte Gesamtschule Schuljahrg…
  51. Studying writing across EFL contexts: Looking back and moving forward
    Writing in foreign language contexts
  52. Assessing Writing
  53. Supporting teacher learning and informed practice in writing through assessment tools for…
    Asia-Pacific Journal of Teacher Education  
  54. Assessing Writing
  55. What beliefs about writing guide EFL curricula? An analysis of relevant policy documents …
    Zeitschrift für Erziehungswissenschaft  
  56. Assessing Writing
  57. An assessment perspective on argumentation in writing
    Journal of Second Language Writing  
  58. Comparative judgement for assessment
    International Journal of Technology and Design Education  
  59. Same language, different functions: A cross-genre analysis of Chinese EFL learners’ writi…
    Journal of Second Language Writing  
  60. A review of rubric use in higher education
    Assessment & Evaluation in Higher Education  
  61. Toward an understanding of the distinct nature of L2 writing: The ESL research and its im…
    TESOL Quarterly  
  62. Assessing Writing