Predictive validity evidence for a no-stakes, untimed, machine-scored diagnostic writing assessment

Elie ChingYen Yu University at Albany, State University of New York ; Oxana Rosca University at Albany, State University of New York ; Heidi L. Andrade ; Angela M. Lui CUNY School of Law ; Jason Bryer CUNY School of Law
Journal
Assessing Writing
Published
2025-10-01
DOI
10.1016/j.asw.2025.100978
CompPile
Search in CompPile ↗
Open Access
Closed
Topics
Export

Citation Context

Cited by in this index (0)

No articles in this index cite this work.

References (97) · 6 in this index

  1. ACT, Inc (2010). A first Looking at the Common Core and College and Career readiness. 〈https://forms.act.org/…
  2. Academic writing difficulties of ESL learners
    The 2015 WEI International academic Conference Proceedings
  3. Diagnosing Foreign Language Proficiency: The Interface Between Learning and Assessment
  4. Summative assessment, test scores and text quality: a study of cohesion as an unspecified…
    European Journal of Educational Research  
  5. Computer-based writing instruction
    Handbook of Writing Research
Show all 97 →
  1. Predicting academic outcomes: a survey from 2007 till 2018
    Technology, Knowledge and Learning
  2. Akhmedjanova, D., Lui, A. M., Andrade, H. L., & Bryer, J. (2019, April 4-8). Validity and reliability of the …
  3. Standards for educational and psychological testing
  4. New evidence on college remediation
    The Journal of Higher Education  
  5. Referral, enrollment, and completion in developmental education sequences in community colleges
    Economics of Education Review  
  6. Bailey, T., Bashford, J., Boatman, A., Squires, J., Weiss, M., Doyle, W., Valentine, J. C., LaSota, R., Polan…
  7. Understanding the gap between high school and college writing
    Assessment Update
  8. Predicting Success in college: The importance of Placement tests and high School transcripts
  9. Best practices for developing and validating scales for health, social, and behavioral re…
    Frontiers in Public Health
  10. The MASUS procedure: measuring the academic skills of university students a diagnostic assessment
  11. Transformation of independent variables
    Technometrics  
  12. Academic literacy and the nonnative speaker graduate student
    Journal of English for Academic Purposes  
  13. The performance assessment study in writing: analysis of the SAT II: writing subject test (College Board Report No. 99-4)
  14. Sex differences in the relationship of advanced placement essay and multiple-choice scores to grades in college courses (ETS Research Report No. RR-91-48)
  15. Bruno, S.C. (2016). The will to write: An assessment of the perceptions of writing readiness and success of f…
  16. The effects and predictive power of the diagnostic assessment and achievement of college …
    Educational Technology and Research Development
  17. (in press). The effects and predictive power of the Diagnostic Assessment and Achievement…
    Educational Technology Research and Development
  18. Bryer, J., Lui, A. M., Franklin, D. W., & Andrade, H. L. (2022, April 21-26). Efficacy of the Diagnostic Asse…
  19. Bryer, J., Lui, A. M., Andrade, H. L., Franklin, D., & Cleary, T. (2019, April 5-9). Efficacy of the Diagnost…
  20. April 23–26). Automated scoring of student essays for diagnostic assessments [Conference presentation]. National Council on Measurement in Education (NCME) Annual Meeting
  21. Purposeful selection of variables in logistic regression
    Source Code for Biology and Medicine  
  22. Cate, C.A. (2014). Million Records Project: Research from Student Veterans of America. Student Veterans of America.
  23. Choy, S. (2002). Nontraditional undergraduates: Findings from the Condition of Education 2002 (NCES 2002-012)…
  24. College Board. (2024). The College Board. 〈https://www.collegeboard.org/〉.
  25. Issues in the reliability and validity of automated scoring of constructed responses
    Automated essay scoring: A cross-disciplinary perspective
  26. Using the diagnostic assessment and achievement of college success (DAACS) to promote SRL…
    New Directions for Teaching and Learning  
  27. Cohen, J., & Cohen, P. (1983). Applied multivariate analysis/linear regression (2nd ed.). Hillsdale.
  28. Applied multiple regression/correlation analysis for the behavioral sciences
  29. Redefining college readiness
    Educational Policy Improvement Center
  30. Residuals and influence in regression
  31. Validity, predictive
    The SAGE encyclopedia of communication research methods
  32. The effect of community college enrollment on bachelor’s degree completion
    Economics of Education Review  
  33. Examining college writing readiness
    The Educational Forum  
  34. Exploring the utility of a web-based English language screening tool
    Language Assessment Quarterly  
  35. Research in the Teaching of English
  36. Closing the gap between high school writing instruction and college writing expectations
    English Journal  
  37. Mitigating risk: the impact of a diagnostic assessment procedure on the first-year experi…
    Post-admission language assessment of university students
  38. How student performance in first year composition predicts retention and overall student …
    Retention, persistence, and writing programs
  39. Predictive validity of the post-enrolment English language assessment tool for commencing…
    Nurse Education Today  
  40. “They say/I say”: The moves that matter in academic writing
  41. Theory of mental tests
  42. Assessing Writing
  43. Identifying students requiring English language support: what role can a PELA play?
    Journal of Academic Language and Learning
  44. Academic literacy skills and progression rates amongst pharmacy students
    Higher Education Research and Development  
  45. Goodness-of-fit test for the multiple logistic regression model
    Communications in Statistics - Theory and Methods  
  46. Applied logistic regression
  47. Academic publishing and the myth of linguistic injustice
    Journal of Second Language Writing  
  48. College English
  49. Jackman, S. (2024). pscl: Classes and methods for R developed in the Political Science Computational Laborato…
  50. Assessing Writing
  51. Diagnostic assessment in language classrooms
    The Routledge Handbook of Language Testing (2nd ed.). Routledge
  52. Ready for university? A cross-national study of students’ perceived preparedness for university
  53. Diagnostic writing assessment: the development and validation of a rating scale
  54. Examining the validity of a post-entry screening tool embedded in a specific policy context
    Post-admission Language Assessment of University Students. English Language Education
  55. Validity evidence of the internal structure of the DAACS self-regulated learning survey. …
    International Journal of Transition, College, and Career Success
  56. Predictive validity of ACCUPLACER® scores for course placement: a Meta-Analysis. research…
    College Board
  57. Basic writing placement with holistically scored essays: research evidence
    Journal of Developmental Education
  58. Validity
    Educational measurement. American Council on Education/Macmillan
  59. The interplay of evidence and consequences in the validation of performance assessments
    Educational Researcher  
  60. Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons' responses an…
  61. Murphy, S., & Yancey, K.B. (2008). Construct and consequence: Validity in writing assessment. In C. Bazerman …
  62. Widening participation and English language proficiency: a convergence with implications …
    Studies in Higher Education  
  63. National Writing Project (2012). National writing project offers high-quality writing assessment services. 〈h…
  64. Evaluating the impact of first-year writing course grades on college-student persistence
    Studies in Educational Evaluation  
  65. Norris, D., Oppler, S., Kuang, D., Day, R., & Adams, K. (2006). The College Board SAT® writing validation stu…
  66. First year students’ perceptions of academic literacies preparedness and embedded diagnos…
    Student Success  
  67. Academic literacy diagnostic assessment in the first semester of first year at university
    The International Journal of the First Year in Higher Education  
  68. First-generation college students: additional evidence on college experiences and outcomes
    The Journal of Higher Education
  69. College Composition and Communication
  70. Relating performance on a standardized writing assessment to performance on selected acad…
    Educational Assessment  
  71. R. Core Team. (2023). R: A language and environment for statistical computing. R Foundation for Statistical C…
  72. Assessing Writing
  73. Implementing the post-entry English language assessment policy at the university of Melbo…
    Journal of Academic Language and Learning
  74. Identifying academic language needs through diagnostic assessment
    Journal of English for Academic Purposes  
  75. Some key issues in post-admission language assessment
    Post- admission language assessment for university students
  76. Contemporary test validity in theory and practice: a primer for discipline-based educatio…
    CBE—Life Sciences Education  
  77. A cautionary note on the effects of range restriction on predictor intercorrelations
    Journal of Applied Psychology  
  78. Correction for range restriction: an expanded typology
    Journal of Applied Psychology  
  79. Scott-Clayton, J. (2012). Do high-stakes placement exams predict college success? (CCRC Working Paper No. 41)…
  80. An analysis of variance test for normality (complete samples)
    Biometrika  
  81. Anchoring validity evidence for automated essay scoring
    Journal of Educational Measurement  
  82. Degree completion among nontraditional college students
    Social Science Quarterly  
  83. Gender differences in scholastic achievement: a meta-analysis
    Psychological Bulletin  
  84. West-Smith, P., Butler, S., & Mayfield, E. (2018, March). Trustworthy automated essay scoring without explici…
  85. Assessing writing
  86. Using PELA to predict international business students’ English writing performance with c…
    Journal of University Teaching Learning Practice  
  87. Writing: Ten Core Concepts
  88. The Essentials of Writing: Ten Core Concepts
  89. The Essentials of Writing: Ten Core Concepts
  90. The diagnostic assessment and achievement of college skills (DAACS): A powerful tool for …
    Technology and innovation in teaching, learning, and education
  91. Do secondary school-leaving English examination results predict university students’ acad…
    Assessment Evaluation in Higher Education  
  92. A handbook on the theory and methods of differential item functioning (DIF): logistic reg…
    Directorate of Human Resources Research and Evaluation