A mixed Rasch model analysis of multiple profiles in L2 writing

Farshad Effatpanah TU Dortmund University ; Purya Baghaei Islamic Azad University, Mashhad ; Mohammad N. Karimi

Abstract

The present study used the Mixed Rasch Model (MRM) to identify multiple profiles in L2 students’ writing with regard to several linguistic features, including content, organization, grammar, vocabulary, and mechanics. To this end, a pool of 500 essays written by English as a foreign language (EFL) students were rated by four experienced EFL teachers using the Empirically-derived Descriptor-based Diagnostic (EDD) checklist. The ratings were subjected to MRM analysis. Two distinct profiles of L2 writers emerged from the sample analyzed including: (a) Sentence-Oriented and (b) Paragraph-Oriented L2 Writers. Sentence-Oriented L2 Writers tend to focus more on linguistic features, such as grammar, vocabulary, and mechanics, at the sentence level and try to utilize these subskills to generate a written text. However, Paragraph-Oriented Writers are inclined to move beyond the boundaries of a sentence and attend to the structure of a whole paragraph using higher-order features such as content and organization subskills. The two profiles were further examined to capture their unique features. Finally, the theoretical and pedagogical implications of the identification of L2 writing profiles and suggestions for further research are discussed.

Journal
Assessing Writing
Published
2024-01-01
DOI
10.1016/j.asw.2023.100803
CompPile
Search in CompPile ↗
Open Access
OA PDF Hybrid
Topics
Export

Citation Context

Cited by in this index (1)

  1. Assessing Writing

References (86) · 9 in this index

  1. Assessing Writing
  2. Spurious latent classes in the mixture Rasch model
    Journal of Educational Measurement  
  3. Fitting the mixed Rasch model to a reading comprehension test: Exploring individual diffe…
    Language Testing  
  4. Language testing in practice: Designing and developing useful language tests
  5. Fitting the mixed Rasch model to a reading comprehension test: Identifying reader types
    Practical Assessment, Research, & Evaluation
Show all 86 →
  1. Applying the mixed Rasch model in assessing reading comprehension
    Quantitative data analysis for language assessment Volume II: Advanced methods
  2. Investigating grammatical complexity in L2 English writing research: Linguistic descripti…
    Journal of English for Academic Purposes  
  3. Applying the Rasch model: Fundamental measurement in the human sciences (4th Ed.)
  4. Model selection and multimodel inference: A practical information-theoretic approach (2nd Ed.)
  5. Written Communication
  6. The role of gender differences in the effect of ideal L2 writing self and imagination on …
    Thinking Skills and Creativity  
  7. Does writing development equal writing quality? A computational investigation of syntacti…
    Journal of Second Language Writing  
  8. Written Communication
  9. The development and use of cohesive devices in L2 writing and their relations to judgment…
    Journal of Second Language Writing  
  10. Predicting human scores of essay quality using computational indices of linguistic and te…
    Proceedings of the 15th International Conference on Artificial Intelligence in Education
  11. Writing motivation and ability profiles and transition during a technology-based writing …
    Frontiers in Psychology  
  12. An introduction to mixture item response theory models
    Journal of School Psychology  
  13. Introduction to many-facet Rasch measurement: Analyzing and evaluating rater-mediated assessments
  14. Cognitive components of writing in a second language: An analysis with the linear logisti…
    Psychological Test and Assessment Modeling
  15. Diagnosing EFL learners' writing ability: A diagnostic classification modeling analysis
    Language Testing in Asia
  16. College Composition and Communication
  17. Exploring multiple profiles of L2 writing using multi- dimensional analysis
    Journal of Second Language Writing  
  18. Revisiting multiple profiles of learner compositions: A comparison of highly rated NS and…
    Journal of Second Language Writing  
  19. Writing as discovery
  20. Using computer-tagged linguistic features to describe L2 writing differences
    Journal of Second Language Writing  
  21. Predictors of spelling and writing skills in first- and second-language learners
    Reading and Writing: An Interdisciplinary Journal  
  22. Written Communication
  23. Written Communication
  24. Informative tools for characterizing individual differences in learning: Latent class, la…
    Learning and Individual Differences  
  25. Facilitating L2 writers’ metacognitive strategy use in argumentative writing using a proc…
    Frontier in Psychology
  26. Options of identity in academic writing
    ELT Journal  
  27. Exploring multiple profiles of highly rated learner compositions
    Journal of Second Language Writing  
  28. A model of working memory in writing
    The science of writing: Theories, methods, individual differences, and applications
  29. The effects of topic familiarity on text quality, complexity, accuracy, and fluency: A co…
    TESOL Quarterly  
  30. Profiles of undergraduate student writers: Differences in writing strategy and impacts on…
    Learning and Individual Differences  
  31. Assessing Writing
  32. Second language reading and writing in relation to first language, vocabulary knowledge, …
    International Journal of Bilingual Education and Bilingualism  
  33. An argument-based validity inquiry into the Empirically-derived Descriptor-based Diagnostic (EDD) assessment in ESL academic writing (Unpublished doctoral dissertation)
  34. The relationship between lexical sophistication and independent and source-based writing
    Journal of Second Language Writing  
  35. Measuring syntactic complexity in L2 writing using fine grained clausal and phrasal indices
    The Modern Language Journal  
  36. Revisiting grammatical complexity in L2 writing via exploratory factor analysis
    Frontiers in Psychology  
  37. Vocabulary size and use: Lexical richness in L2 written production
    Applied Linguistics  
  38. Latent structure analysis
  39. What linguistic features distinguish and predict L2 writing quality? A study of examinati…
    System  
  40. Examining the transcription-writing link: Effects of handwriting fluency and spelling acc…
    Learning and Individual Differences  
  41. Linacre, J.M. (1989). Many-facet Rasch measurement. MESA Press.
  42. What do infit and outfit, mean-square and standardized mean?
    Rasch Measurement Transactions
  43. Linacre, J.M. (2014a). Facets Rasch measurement. Chicago, IL: Winsteps.com (Computer program).
  44. Linacre, J.M. (2014b). A user’s guide to Facets Rasch-model computer programs. Chicago, IL: Winsteps.com.
  45. Written Communication
  46. Natural language processing in an intelligent writing strategy tutoring system
    Behavior Research Methods  
  47. Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd Ed., pp. 1–103). American Cou…
  48. The relationship between the discourse knowledge and the writing performance of elementar…
    Journal of Educational Psychology  
  49. Syntactic complexity in L2 writing: Progress and expansion
    Journal of Second Language Writing  
  50. Parameter recovery and model selection in mixed Rasch models
    British Journal of Mathematical and Statistical Psychology  
  51. Language development for English-medium instruction: A longitudinal perspective on the us…
    Sustainability
  52. Rasch, G. (1960/1980). Probabilistic models for some intelligence and attainment tests (Expanded Ed.). Univer…
  53. Rasch models in latent classes: An integration of two approaches to item analysis
    Applied Psychological Measurement  
  54. A conditional item-fit index for Rasch models
    Applied Psychological Measurement  
  55. Writing performance and knowledge about writing
    Theories, models, and methodology in writing research
  56. Towards a blueprint of the foreign language writer: The linguistic and cognitive demands …
    Writing in foreign language: Contexts learning, teaching, and research
  57. Modeling the development of L1 and EFL writing proficiency of secondary school students
    Language Learning  
  58. First language and second language writing: The role of linguistic knowledge, speed of pr…
    Language Learning  
  59. Spurious latent class problem in the mixed Rasch model: A comparison of three maximum lik…
    International Journal of Testing  
  60. Applications of mixture IRT models: A literature review
    Measurement: Interdisciplinary Research and Perspectives
  61. Model selection for multilevel mixture Rasch models
    Applied Psychological Measurement  
  62. Using multivariate statistics (6th Ed.)
  63. The writing strategies of graduate research students in the social sciences
  64. Individual differences in under-graduate essay-writing strategies: A longitudinal study
    Higher Education  
  65. Latent profiles of writing-related skills, knowledge, and motivation for elementary stude…
    Contemporary Educational Psychology
  66. The Q-Matrix anchored mixture Rasch model
    Frontiers in Psychology  
  67. Does foreign language writing benefit from increased lexical fluency? Evidence from a cla…
    Language Learning  
  68. The effects of working memory and L2 proficiency on L2 writing
    Journal of Second Language Writing  
  69. The impact of vocabulary and spelling on judgments of ESL essays: An analysis of teacher …
    The Language Learning Journal  
  70. von Davier, M. (2001a). WINMIRA [computer program]. Groningen, the Netherlands: ASC-Assessment Systems Corpor…
  71. von Davier, M. (2001b). WINMIRA user manual. Groningen, the Netherlands: ASC- Assessment Systems Corporation.…
  72. The mixture general diagnostic model
    Advances in latent variable mixture models
  73. Polytomous mixed Rasch models
    Rasch models: Foundations, recent developments, and applications
  74. Assessing writing
  75. Latent class analysis: A guide to best practice
    Journal of Black Psychology  
  76. Journal of Writing Research
  77. A systematic review of methods for evaluating rating quality in language assessment
    Language Testing  
  78. The use of cohesive devices in argumentative writing by Chinese EFL learners at different…
    Linguistics and Education  
  79. Different topics, different discourse: Relationships among writing topic, measures of syn…
    Journal of Second Language Writing  
  80. The relationship between lexical use and L2 writing quality: A case of two genres
    International Journal of Applied Linguistics  
  81. Metacognitive strategy use in L2 writing assessment
    System