A Product- and Process-Oriented Tagset for Revisions in Writing

Rianne Conijn Eindhoven University of Technology ; Emily Dux Speltz Iowa State University ; Menno van Zaanen ; Luuk Van Waes University of Antwerp ; Evgeny Chukharev-Hudilainen

Abstract

The study of revision has been a topic of interest in writing research over the past decades. Numerous studies have, for instance, shown that learning-to-revise is one of the key competences in writing development. Moreover, several models of revision have been developed, and a variety of taxonomies have been used to measure revision in empirical studies. Current advances in data collection and analysis have made it possible to study revision in increasingly precise detail. The present study aimed to combine previous models and current advances by providing a comprehensive product- and process-oriented tagset of revision. The presented tagset includes properties of external revisions: trigger, orientation, evaluation, action, linguistic domain, spatial location, temporal location, duration, and sequencing. We identified how keystroke logging, screen replays, and eye tracking can be used to extract both manually and automatically extract features related to these properties. As a proof of concept, we demonstrate how this tagset can be used to annotate revisions made by higher education students in various academic tasks. To conclude, we discuss how this tagset forms a scalable basis for studying revision in writing in depth.

Journal
Written Communication
Published
2022-01-01
DOI
10.1177/07410883211052104
Open Access
OA PDF Hybrid
Topics

Citation Context

Cited by in this index (1)

  1. College Composition and Communication

Cites in this index (7)

  1. Written Communication
  2. Written Communication
  3. College Composition and Communication
  4. Research in the Teaching of English
  5. College Composition and Communication
Show all 7 →
  1. College Composition and Communication
  2. College Composition and Communication
Also cites 39 works outside this index ↓
  1. 10.1007/978-94-007-1048-1
  2. 10.1163/9789004392526_004
  3. Baaijen V. M., Galbraith D. (2018). Discovery through writing: Relationships with writing processes and text …
  4. Barkaoui K. (2016). What and when second-language learners revise when responding to timed writing tasks on t…
  5. Boytsov L. (2011). Indexing methods for approximate dictionary searching: Comparative analysis. Journal of Ex…
  6. Breetvelt I., Van den Bergh H., Rijlaarsdam G. (1994). Relations between writing processes and text quality: …
  7. Chukharev-Hudilainen E. (2019). Empowering automated writing evaluation with keystroke logging. In Lindgren E…
  8. Chukharev-Hudilainen E., Saricaoglu A., Torrance M., Feng H.H. (2019). Combined deployable keystroke logging …
  9. Conijn R., Dux Speltz E., van Zaanen M., Van Waes L., Chukharev-Hudilainen E. (2020). A process-oriented data…
  10. Crawford L., Lloyd S., Knoth K. (2008). Analysis of student revisions on a state writing test. Assessment for…
  11. Damerau F. J. (1964). A technique for computer detection and correction of spelling errors. Communications of…
  12. Figueredo L., Varnhagen C. K. (2006). Spelling and grammar checkers: Are they intrusive? British Journal of E…
  13. Fitzgerald J. (1987). Research on revision in writing. Review of Educational Research, 57(4), 481-506. https:…
  14. 10.1163/9789004392526_015
  15. Leijten M., Van Horenbeeck E., Van Waes L. (2019). Analysing keystroke logging data from a linguistic perspec…
  16. Leijten M., Van Waes L., Schriver K., Hayes J. R. (2014). Writing in the workplace: Constructing documents us…
  17. Limpo T., Alves R. A., Fidalgo R. (2014). Children’s high-level writing skills: Development of planning and r…
  18. Computer keystroke logging and writing: Methods and applications (studies in writing)
  19. Computer keystroke logging and writing: Methods and applications (studies in writing)
  20. Lindgren E., Westum A., Outakoski H., Sullivan K. P. H. (2019). Revising at the leading edge: Shaping ideas o…
  21. Min H.T. (2006). The effects of trained peer review on EFL students’ revision types and writing quality. Jour…
  22. Révész A., Kourtali N.E., Mazgutova D. (2017). Effects of task complexity on L2 writing behaviors and linguis…
  23. Sengupta S. (2000). An investigation into the effects of revision strategy instruction on L2 secondary school…
  24. Severinson-Eklundh K., Kollberg P. (2001). Studying writers’ revision patterns with S-notation analysis. In O…
  25. Stevenson M., Schoonen R., de Glopper K. (2006). Revising in two languages: A multi-dimensional comparison of…
  26. Thorson H. (2000). Using the computer to compare foreign and native language writing processes: A statistical…
  27. Tillema M., van den Bergh H., Rijlaarsdam G., Sanders T. (2011). Relating self reports of writing behaviour a…
  28. Van Waes L., Schellens P. J. (2003). Writing profiles: The effect of the writing mode on pausing and revision…
  29. Vandermeulen N., Leijten M., Van Waes L. (2020). Reporting writing process feedback in the classroom: Using k…
  30. Verbert K., Govaerts S., Duval E., Santos J. L., Assche F., Parra G., Klerkx J. (2014). Learning dashboards: …
  31. Wengelin Å. (2007). The word-level focus in text production by adults with reading and writing difficulties. …
  32. Winder R., Kathpalia S. S., Koo S. L. (2016). Writing centre tutoring sessions: Addressing students’ concerns…
  33. Wobbrock J. O., Myers B. A. (2006). Analyzing the input stream for character-level errors in unconstrained te…
  34. Xu C. (2018). Understanding online revisions in L2 writing: A computer keystroke-log perspective. System, 78(…
  35. Xue H., Hwa R. (2014, June 23-25). Improved correction detection in revised ESL sentences. In Proceedings of …
  36. Zhang F., Hwa R., Litman D., Hashemi H. B. (2016, June 12-17). ArgRewrite: A web-based revision assistant for…
  37. Zhang F., Litman D. (2015). Annotation and classification of argumentative writing revisions. In Proceedings …
  38. Zhang M., Hao J., Li C., Deane P. (2016). Classification of writing patterns using keystroke logs. In van der…
  39. Zhu M., Zhang M., Deane P. (2019). Analysis of keystroke sequences in writing logs. ETS Research Report Serie…
CrossRef global citation count: 14 View in citation network →