Assessing Writing Oct 2022 Open Access

Integrated writing and its correlates: A meta-analysis

Sathena Chan University of Bedfordshire ; Junko Yamashita Nagoya University

Abstract

Integrated tasks are increasing in popularity, either replacing or complementing writing-only independent tasks in writing assessments. This shift has generated many research interests to investigate the underlying construct and features of integrated writing (IW) performances. However, due to the complexity of the IW construct, there are conflicting findings about whether and the extent to which various language skills and IW text features correlate to IW scores. To understand the construct of IW, we conducted a meta-analysis to synthesize correlation coefficients between scores of IW performances and (1) other language skills and (2) text quality features of IW. We also examined factors that may moderate the correlation of IW scores with these two groups of correlates. Consequently, (1) reading and writing skills showed stronger correlations than listening to IW scores; and (2) text length had a strongest correlation, followed by source integration, organization and syntactic complexity, with a smallest correlation of lexical complexity. Several IW task features affected the magnitude of correlations. The results supported the view that IW is an independent construct, albeit related, from other language skills and IW task features may affect the construct of IW.

Journal
Assessing Writing
Published
2022-10-01
DOI
10.1016/j.asw.2022.100662
CompPile
Search in CompPile ↗
Open Access
OA PDF Hybrid
Topics
writing pedagogy assessment grammar and mechanics literacy studies affect and writing
Export
BibTeX RIS

Citation Context

Cited by in this index (9)

  1. Shackleton et al. (2026)
    Developing a rating scale for written intralinguistic mediation in a local context
    Assessing Writing
  2. Liao et al. (2025)
    The relationship between executive functions, source use, and integrated writin…
    Assessing Writing
  3. Zhu et al. (2025)
    Towards a better understanding of integrated writing performance: The influence…
    Assessing Writing
  4. Karakoҫ et al. (2025)
    Designing a rating scale for an integrated reading-writing test: A needs-orient…
    Assessing Writing
  5. Xie (2024)
    Construct representation and predictive validity of integrated writing tasks: A…
    Assessing Writing
Show all 9 →
  1. Cai et al. (2024)
    Examining the direct and indirect impacts of verbatim source use on linguistic …
    Assessing Writing
  2. Grabowski et al. (2024)
    A Direct Functional Measure of Text Quality: Did the Reader Understand?
    Written Communication
  3. Emmanouil et al. (2024)
    Linguistic factors affecting L1 language evaluation in argumentative essays of …
    Assessing Writing
  4. Arias-Hermoso et al. (2024)
    A comparison between input modalities and languages in source-based multilingua…
    Assessing Writing

References (70) · 11 in this index

  1. Asención Delaney (2008)
    Investigating the reading-to-write construct
    Journal of English for Academic Purposes  ↗
  2. Baba (2009)
    Aspects of lexical proficiency in writing summaries in a foreign language
    Journal of Second Language Writing  ↗
  3. Barkaoui (2014)
    Examining the impact of L2 proficiency and keyboarding skills on scores on TOEFL-iBT writ…
    Language Testing  ↗
  4. Borenstein (2005)
    Comprehensive meta-analysis (Version 2) [computer software]
  5. Chan (2018)
    Defining Integrated Reading-into-Writing Constructs: Evidence at the B2 C1 Interface
    English Profile Series Studies 08
Show all 70 →
  1. Chan et al. (2015)
    Developing rubrics to assess the reading-into-writing skills: A case study
    Assessing Writing
  2. Chan, S., & May, L. (2019). The features of effective summary writing: reading-into-writing and listening-int…
  3. Cheong (2018)
    Differences between the relationship of L1 learners’ performance in integrated writing wi…
    Reading and Writing  ↗
  4. Cheong (2019)
    Effects of intertextual processing on L2 integrated writing
    Journal of Second Language Writing  ↗
  5. Cheung (2015)
    Meta-analysis: A structural equation modeling approach
  6. Cohen (1988)
    Statistical power analysis for the behavioral sciences
  7. Cumming (2014)
    Assessing integrated skills
    Companion to language assessment
  8. Cumming (2016)
    Students’ writing from sources for academic purposes: A synthesis of recent research
    Journal of English for Academic Purposes  ↗
  9. Cumming et al. (2005)
    Differences in written discourse in independent and integrated prototype tasks …
    Assessing Writing
  10. Cumming (2006)
    Analysis of discourse features and verification of scoring levels for independent and int…
    TOEFL monograph
  11. Duval (2000)
    A nonparametric trim and fill method of accounting for publication bias in meta-analysis
    Journal of the American Statistical Association
  12. Farnia (2013)
    Growth and predictors of change in English language learners’ reading comprehension
    Journal of Research in Reading  ↗
  13. Field (2019)
    Rethinking the Second Language Listening Test From Theory to Practice. British Council Monographs on Modern Language Testing 2
  14. Flower (1980)
    The dynamic of composing: Making plans and juggling constraints
    Cognitive processes in writing: An interdisciplinary approach
  15. Galbraith (2009)
    Cognitive models of writing
    German as a Foreign Language
  16. Gebril (2016)
    Source-based tasks in academic writing assessment: Lexical diversity, textual borrowing a…
    Journal of English for Academic Purposes  ↗
  17. Gelati (2014)
    Summary writing as a tool for improving the com- prehension of expository texts: An inter…
    Writing as a learning activity
  18. Graesser (2004)
    Coh-Metrix: Analysis of text on cohesion and language
    Behavior Research Methods, Instruments, & Computers  ↗
  19. Guo et al. (2013)
    Predicting human judgments of essay quality in both integrated and independent …
    Assessing Writing
  20. Hale, G., Taylor, C., Bridgeman, B., Carson, J., Kroll, B., & Kantor, R. (1996). A study of writing tasks ass…
     ↗
  21. Hidi (1986)
    Produce written summaries: Task demands, cognitive operations, and implications for instruction
    Review of Educational Research  ↗
  22. Homayounzadeh et al. (2019)
    Investigating the effect of source characteristics on task comparability in int…
    Assessing Writing
  23. Howells (2011)
    Literature: reading to write
  24. In’nami (2009)
    A meta-analysis of test format effects on reading and listening test performance: Focus o…
    Language Testing  ↗
  25. Kato (2018)
    Exploring the transfer relationship of summarizing skills in L1 and L2
    English Language Teaching  ↗
  26. Kato (2018)
    Exploring the transfer relationship of summarizing skills in L1 and L2
    English Language Teaching  ↗
  27. Keck (2006)
    The use of paraphrase in summary writing: A comparison of L1 and L2 writers
    Journal of Second Language Writing  ↗
  28. Keck (2014)
    Copying, paraphrasing, and academic writing development: A re-examination of L1 and L2 su…
    Journal of Second Language Writing  ↗
  29. Khalifa (2009)
    Examining reading: Research and practice in assessing second language reading, studies in language testing
  30. Kintsch (1978)
    Toward a model of text comprehension and production
    Psychological Review  ↗
  31. Knoch et al. (2013)
    A closer look at integrated writing tasks: Towards a more focussed definition f…
    Assessing Writing
  32. Kyle (2016)
    The relationship between lexical sophistication and independent and source-based writing
    Journal of Second Language Writing  ↗
  33. Leopold (2019)
    Summarizing as a strategy for science text comprehension: Text-based versus content-based…
    Discourse Processes  ↗
  34. Llosa (2019)
    Comparability of students’ writing performance on TOEFL iBT and in required university wr…
    Language Testing  ↗
  35. Mancilla-Martinez (2011)
    Investigating English reading comprehension growth in adolescent language minority learne…
    Reading and Writing  ↗
  36. Nguyen (2019)
    Source-use expectations in assignments: The perceptions and practices ofVietnamese master…
    English for Specific Purposes  ↗
  37. Ohta et al. (2018)
    Integrated writing scores based on holistic and multi-trait scales: A generaliz…
    Assessing Writing
  38. Orwin (1983)
    A fail-safe N for effect size in meta-analysis
    Journal of Educational Statistics
  39. Payant (2019)
    Predicting integrated writing task performance: Source comprehension, prewriting planning…
    Journal of English for Academic Purposes  ↗
  40. Pečjak (2018)
    Developing summarizing skills in 4th grade students: Intervention programme effects
    International Electronic Journal of Elementary Education  ↗
  41. Perin (2017)
    Text-based writing of low-skilled postsecondary students: Relation to comprehension, self…
    Reading and Writing  ↗
  42. Peverly (2007)
    What predicts skill in lecture note taking
    Journal of Educational Psychology  ↗
  43. Peverly (2007)
    What predicts skill in lecture note taking?
    Journal of Educational Psychology  ↗
  44. Phillips Galloway (2019)
    Beyond reading comprehension: exploring the additional contribution of core academic lang…
    Reading and Writing  ↗
  45. Phillips Galloway (2020)
    The role of cross-disciplinary academic language skills in disciplinary, source-based wri…
    Reading and Writing  ↗
  46. Plakans (2008)
    Comparing composing processes in writing-only and reading-to-write test tasks
    Assessing Writing
  47. Plakans et al. (2012)
    A close investigation into source use in integrated second language writing tasks
    Assessing Writing
  48. Plakans (2013)
    Using multiple texts in an IW assessment: Source text use as a predictor of score
    Journal of Second Language Writing  ↗
  49. Rosenfeld, M., Leung, S., & Oltman, P. K. (2001). The reading, writing, speaking, and listening tasks importa…
  50. Rosenthal (1979)
    The file drawer problem and tolerance for null results
    Psychological Bulletin  ↗
  51. Sánchez (2017)
    Does rhetorical competence moderate the effect of rhetorical devices on the comprehension…
    Reading and Writing  ↗
  52. Scardamalia (1987)
    Knowledge telling and knowledge transforming in written composition
    Advances in applied psycholinguistics, volume 2: Reading, writing and language learning
  53. Shaw (2007)
    Examining writing: Research and practice in assessing second language writing, Studies in Language Testing 26
  54. Shi (2004)
    Textual Borrowing in Second-Language Writing
    Written Communication
  55. Shin (2015)
    What accounts for integrated reading-to-write task scores
    Language Testing  ↗
  56. Spivey (1997)
    The constructivist metaphor: Reading, writing and the making of meaning
  57. Spivey (1989)
    Readers as writers composing from sources
    Reading Research Quarterly  ↗
  58. Taylor (2013)
    Testing reading through summary. Studies in language testing
  59. Uccelli (2019)
    The role of language skills in mid-adolescents’ science summaries
    Journal of Literacy Research  ↗
  60. Watanabe (2001)
    Read-to-write tasks for the assessment of second language academic writing skills: Investigating text features and rater reactions
  61. Weigle (2004)
    Integrating reading and writing in a competency test for non-native speakers of…
    Assessing Writing
  62. Ye et al. (2019)
    Source use in the story continuation writing task
    Assessing Writing
  63. Yu (2007)
    Reading to summarize in English and Chinese: A tale of two languages?
    Language Testing
  64. Yu (2013)
    The use of summarization tasks: Some lexical and conceptual analyses
    Language Assessment Quarterly  ↗
  65. Zhu (2016)
    Exploring the relationships between independent listening and listening-reading-writing t…
    Language Assessment Quarterly  ↗
CrossRef global citation count: 18 View in citation network → Build reading path →

Related Articles

  1. Assessing Writing Jan 2026
    How reliable and valid is peer evaluation in adolescents’ L2 argumentative writing? ↗
    Albert W. Li; Steve Graham
    writing pedagogy teacher development argument assessment multilingual writers grammar and mechanics literacy studies
  2. Pedagogy Apr 2024
    Contributors ↗
    modern rhetorical theory rhetorical criticism feminist rhetorics first-year composition writing pedagogy creative writing teacher development collaborative writing assessment technical communication professional writing grammar and mechanics literacy studies gender and writing literary studies book reviews editorial matter
  3. Pedagogy Oct 2023
    Contributors ↗
    rhetorical criticism first-year composition writing pedagogy writing across the curriculum two-year college teacher development collaborative writing assessment writing centers qualitative research multimodality literacy studies race and writing gender and writing disability studies affect and writing literary studies book reviews editorial matter
  4. Pedagogy Jan 2022
    Contributors ↗
    modern rhetorical theory rhetorical criticism genre theory discourse analysis african american rhetorics decolonial rhetorics first-year composition writing pedagogy basic writing writing across the curriculum graduate education teacher development argument collaborative writing transfer assessment portfolios writing program administration writing centers peer tutoring technical communication professional writing archival research digital rhetoric social media grammar and mechanics literacy studies race and writing gender and writing disability studies public rhetoric community literacy literary studies editorial matter
  5. Pedagogy Oct 2021
    Contributors ↗
    rhetorical criticism discourse analysis writing pedagogy graduate education two-year college teacher development collaborative writing transfer assessment labor and working conditions multimodality social media online writing instruction multilingual writers literacy studies race and writing gender and writing public rhetoric community literacy affect and writing literary studies editorial matter