The design and cognitive validity verification of reading-to-write tasks in L2 Chinese writing assessment

Rujun Pan Beijing Language and Culture University ; Xiaofei Lu Pennsylvania State University

Abstract

Reading-to-write (RTW) tasks have been commonly employed in second language (L2) English academic writing pedagogy, and many studies have investigated the validity and reliability of RTW tasks in L2 English writing assessment. Meanwhile, few studies have examined the cognitive validity of RTW tasks, and the design and validation of such tasks in L2 Chinese academic writing assessment remain underexplored. This study develops a Chinese RTW task following a set of design criteria and procedures and evaluates its cognitive validity as an instrument of L2 Chinese academic writing assessment. The RTW task was administered to 15 undergraduate and 15 postgraduate L2 Chinese learners in an eye-tracking laboratory. Analyses of the task features and the eye-tracking and stimulated recall interview data suggested that the RTW task largely aligned with the characteristics of authentic tasks in real L2 Chinese academic writing contexts and elicited a representative range of cognitive processes in existing models of RTW cognitive processes. Many of these processes manifested in different ways between the two groups of participants at different L2 Chinese proficiency levels. Our findings have useful implications for understanding the cognitive validity of the RTW task in L2 Chinese writing assessment.

Journal
Assessing Writing
Published
2023-04-01
DOI
10.1016/j.asw.2023.100699
CompPile
Search in CompPile ↗
Open Access
OA PDF Hybrid
Topics
Export

Citation Context

Cited by in this index (0)

No articles in this index cite this work.

References (50) · 11 in this index

  1. Investigating learners’ cognitive processes during a computer-based CAE reading test
    Research Notes
  2. Developing Chinese intermediate writing course (2nd ed.)
  3. Developing Chinese advanced writing course
  4. Establishing the validity of reading-into-writing test tasks for the UK academic context …
    University of Bedfordshire
  5. The coming of age of research on test-taking strategies
    Language Assessment Quarterly  
Show all 50 →
  1. A teacher-verification study of speaking and writing prototype tasks for a new TOFEL
    Language Testing  
  2. Assessing integrated writing tasks: Promises and perils
    Language Assessment Quarterly  
  3. Assessing Writing
  4. Investigating the reading-to-write construct
    Journal of English for Academic Purposes  
  5. An exploratory analysis of source integration in post-secondary L1 and L2 source-based writing
    English for Specific Purposes  
  6. Field, J. (2004). Psycholinguistics: The key concepts. London: Routledge.
  7. Field, J. (2005). Second language writing: A language problem or a writing problem? Paper presented at the IA…
  8. Cognitive validity
    Examining speaking: Research and practice in assessing second language speaking
  9. The cognitive validity of the lecture-based question in the IELTS Academic Listening paper
    IELTS collected papers 2: Research in reading and listening assessment
  10. Cognitive validity
    Examining listening: Research and practice in assessing second language listening
  11. The role of L2 writing self-efficacy in integrated writing strategy use and performance
    -Science Direct Assessing Writing
  12. Reading and writing relations: Theoretical perspectives and instructional practices
    Linking literacies: Perspectives on L2 reading-writing connections
  13. Theory and practice of writing
  14. Assessing Writing
  15. Assessing Writing
  16. Identifying the organization of writing processes
    Cognitive processes in writing
  17. Hayes, J.R., & Flower, L.S. (1983). A cognitive model of the writing process in adults (Report No. ED240608).…
  18. Lexical processing during saccadic eye movements
    Cognitive Psychology  
  19. Chi-Editor: An online Chinese test evaluation and adaptation system.
  20. Examining reading: Research and practice in assessing second language reading
  21. Comprehension: A paradigm for cognition
  22. Assessing Writing
  23. The relationship between lexical sophistication and independent and source-based writing
    Journal of Second Language Writing  
  24. Reading during an academic reading-into-writing task: An eye-tracking study [Unpublished …
    University of Bedfordshire
  25. Validity and topic generality of a writing performance test
    Language Testing  
  26. Investigating the construct measured by banked gap-fill items: Evidence from eye-tracking
    Language Testing  
  27. Validity
    Educational Measurement
  28. Calibrating genre: Metacognitive judgments and rhetorical effectiveness in academic writi…
    Applied Linguistics
  29. Test development and validation
    Language testing: Theories and practices
  30. An evidence-centred approach to reverse engineering: Comparative analysis of IELTS and TO…
    University of Leicester
  31. Assessing Writing
  32. Assessing Writing
  33. Using multiple texts in an integrated writing assessment: Source text use as a predictor …
    Journal of Second Language Writing  
  34. Assessing Writing
  35. Shaping a score: Complexity, accuracy, and fluency in integrated writing performances
    Language Testing  
  36. Assessing Writing
  37. Perceptions and beliefs about textual appropriation and source use in second language writing
    Journal of Second Language Writing  
  38. Assessing Writing
  39. Examining writing: Research and practice in assessing second language writing
  40. Written Communication
  41. The constructivist metaphor: Reading, writing, and the making of meaning
    Journal of Literacy Research
  42. Assessing Writing
  43. Language testing and validation
  44. The cognitive processes underlying the academic reading construct as measured by IELTS
    IELTS Research Reports
  45. Second language writers’ strategy use and performance on an integrated reading‐listening‐…
    TESOL Quarterly