Assessing Writing Oct 2018

Integrated writing scores based on holistic and multi-trait scales: A generalizability analysis

Renka Ohta ; Lia M. Plakans ; Atta Gebril
Journal
Assessing Writing
Published
2018-10-01
DOI
10.1016/j.asw.2018.08.001
CompPile
Search in CompPile ↗

Citation Context

Cited by in this index (9)

  1. Lee et al. (2025)
    Predicting inappropriate source use from scores of language use, source compreh…
    Assessing Writing
  2. Karakoҫ et al. (2025)
    Designing a rating scale for an integrated reading-writing test: A needs-orient…
    Assessing Writing
  3. Reed et al. (2023)
    Resiliency and vulnerability in early grades writing performance during the COV…
    Assessing Writing
  4. Lee (2023)
    Diagnosing Chinese college-level English as a Foreign Language (EFL) learners’ …
    Assessing Writing
  5. Xie (2023)
    Assessing source use: Summary vs. reading-to-write argumentative essay
    Assessing Writing
Show all 9 →
  1. Elosua (2022)
    Validity evidences for scoring procedures of a writing assessment task. A case …
    Assessing Writing
  2. Chan et al. (2022)
    Integrated writing and its correlates: A meta-analysis
    Assessing Writing
  3. Li et al. (2022)
    The impact of essay organization and overall quality on the holistic scoring of…
    Assessing Writing
  4. Zheng et al. (2019)
    What has been assessed in writing and how? Empirical evidence from Assessing Wr…
    Assessing Writing

Cites in this index (15)

  1. Wang et al. (2017)
    Evaluating rater accuracy and perception for integrated writing assessments usi…
    Assessing Writing
  2. Hamp-Lyons (2016)
    Farewell to holistic scoring. Part Two: Why build a house with only one brick?
    Assessing Writing
  3. Hamp-Lyons (2016)
    Farewell to Holistic Scoring?
    Assessing Writing
  4. Chan et al. (2015)
    Developing rubrics to assess the reading-into-writing skills: A case study
    Assessing Writing
  5. Ewert et al. (2015)
    Examining instructors’ conceptualizations and challenges in designing a data-dr…
    Assessing Writing
Show all 15 →
  1. Gebril et al. (2014)
    Assembling validity evidence for assessing academic writing: Rater reactions to…
    Assessing Writing
  2. Huang (2012)
    Using generalizability theory to examine the accuracy and validity of large-sca…
    Assessing Writing
  3. Plakans et al. (2012)
    A close investigation into source use in integrated second language writing tasks
    Assessing Writing
  4. Gebril (2010)
    Bringing reading-to-write and writing-only assessment tasks together: A general…
    Assessing Writing
  5. East (2009)
    Evaluating the reliability of a detailed analytic scoring rubric for foreign la…
    Assessing Writing
  6. Barkaoui (2007)
    Rating scale impact on EFL essay marking: A mixed-method study
    Assessing Writing
  7. Sudweeks et al. (2004)
    A comparison of generalizability theory and many-facet Rasch measurement in an …
    Assessing Writing
  8. Weigle (2004)
    Integrating reading and writing in a competency test for non-native speakers of…
    Assessing Writing
  9. Veal et al. (1983)
    Direct and Indirect Measures for Large-Scale Evaluation of Writing
    Research in the Teaching of English
  10. Follman et al. (1967)
    An Investigation of the Reliability of Five Procedures for Grading English Themes
    Research in the Teaching of English
Also cites 27 works outside this index ↓
  1. Bacha (2001)
    Writing evaluation: What can analytic versus holistic essay scoring tell us?
    System  ↗
  2. Bachman (1995)
    Investigating variability in tasks and rater judgements in a performance test of foreign …
    Language Testing  ↗
  3. Brennan (1995)
    Generalizability of performance assessments
    Educational Measurement Issues and Practice  ↗
  4. Briesch (2014)
    Generalizability theory: A practical guide to study design, implementation, and interpretation
    Journal of school psychology  ↗
  5. Bruce (2015)
    Opposing tensions of local and international standards for EAP writing programmes: Who ar…
    Journal of English for Academic Purposes  ↗
  6. Carr (2000)
    A comparison of the effects of analytic and holistic composition in the context of compos…
    Issues in Applied Linguistics  ↗
  7. Cast (1939)
    The efficiency of different methods of marking English composition. Part I
    British Journal of Educational Psychology  ↗
  8. Cast (1940)
    The efficiency of different methods of marking English composition. Part II
    British Journal of Educational Psychology  ↗
  9. Cronbach (2004)
    My current thoughts on coefficient alpha and successor procedures
    Educational and Psychological Measurement  ↗
  10. Esmaeili (2002)
    Integrated reading and writing tasks and ESL students’ reading and writing performance in…
    Canadian Modern Language Review/La Revue canadienne des langues vivantes  ↗
  11. Gebril (2009)
    Score generalizability of academic writing tasks: Does one test method fit it all?
    Language Testing  ↗
  12. Gebril (2013)
    Toward a transparent construct of reading-to-write tasks: The interface between discourse…
    Language Assessment Quarterly  ↗
  13. Ghanbari (2012)
    Problematizing rating scales in EFL academic writing assessment: Voices from Iranian context
    English Language Teaching  ↗
  14. Hamp-Lyons (1995)
    Rating nonnative writing: The trouble with holistic scoring
    TESOL Quarterly  ↗
  15. Harsch (2013)
    Comparing holistic and analytic scoring methods: Issues of validity and reliability
    Assessment in Education Principles Policy and Practice  ↗
  16. In’nami (2016)
    Task and rater effects in L2 speaking and writing: A synthesis of generalizability studies
    Language Testing  ↗
  17. Kane (2013)
    Validating the interpretations and uses of test scores
    Journal of Educational Measurement  ↗
  18. Lee (2007)
    Evaluating prototype tasks and alternative rating schemes for a new ESL writing test thro…
    International Journal of Testing  ↗
  19. Lee (2010)
    Toward automated multi-trait scoring of essays: Investigating relationships among holisti…
    Applied Linguistics  ↗
  20. Leki (1997)
    “Completely different worlds”: EAP and the writing experiences of ESL students in univers…
    TESOL Quarterly  ↗
  21. Li (2015)
    A comparison of EFL raters’ essay-rating processes across two types of rating scales
    Language Assessment Quarterly  ↗
  22. Lumley (2002)
    Assessment criteria in a large-scale writing test: What do they really mean to the raters?
    Language Testing  ↗
  23. Lynch (1998)
    Using G-theory and many-facet Rasch measurement in the development of performance assessm…
    Language Testing  ↗
  24. McNamara (2012)
    The Rasch wars: The emergence of Rasch measurement in language testing
    Language Testing  ↗
  25. Plakans (2013)
    Using multiple texts in an integrated writing assessment: Source text use as a predictor …
    Journal of Second Language Writing  ↗
  26. Schoonen (2005)
    Generalizability of writing scores: An application of structural equation modeling
    Language Testing  ↗
  27. Shin (2015)
    What accounts for integrated reading-to-write task scores?
    Language Testing  ↗
CrossRef global citation count: 32 View in citation network →