A Product- and Process-Oriented Tagset for Revisions in Writing

Rianne Conijn Eindhoven University of Technology ; Emily Dux Speltz Iowa State University ; Menno van Zaanen ; Luuk Van Waes University of Antwerp ; Evgeny Chukharev-Hudilainen

Abstract

The study of revision has been a topic of interest in writing research over the past decades. Numerous studies have, for instance, shown that learning-to-revise is one of the key competences in writing development. Moreover, several models of revision have been developed, and a variety of taxonomies have been used to measure revision in empirical studies. Current advances in data collection and analysis have made it possible to study revision in increasingly precise detail. The present study aimed to combine previous models and current advances by providing a comprehensive product- and process-oriented tagset of revision. The presented tagset includes properties of external revisions: trigger, orientation, evaluation, action, linguistic domain, spatial location, temporal location, duration, and sequencing. We identified how keystroke logging, screen replays, and eye tracking can be used to extract both manually and automatically extract features related to these properties. As a proof of concept, we demonstrate how this tagset can be used to annotate revisions made by higher education students in various academic tasks. To conclude, we discuss how this tagset forms a scalable basis for studying revision in writing in depth.

Journal
Written Communication
Published
2022-01-01
DOI
10.1177/07410883211052104
CompPile
Search in CompPile ↗
Open Access
OA PDF Hybrid
Topics
Export

Citation Context

Cited by in this index (1)

  1. College Composition and Communication

References (60) · 9 in this index

  1. Metalinguistic activity in learning to write
  2. 10.1007/978-94-007-1048-1
  3. 10.1163/9789004392526_004
  4. Baaijen V. M., Galbraith D. (2018). Discovery through writing: Relationships with writing processes and text …
  5. Written Communication
Show all 60 →
  1. Barkaoui K. (2016). What and when second-language learners revise when responding to timed writing tasks on t…
  2. Natural language processing with Python
  3. Written Communication
  4. Boytsov L. (2011). Indexing methods for approximate dictionary searching: Comparative analysis. Journal of Ex…
  5. Breetvelt I., Van den Bergh H., Rijlaarsdam G. (1994). Relations between writing processes and text quality: …
  6. Inventory of European programmes for teaching thinking
  7. Chukharev-Hudilainen E. (2019). Empowering automated writing evaluation with keystroke logging. In Lindgren E…
  8. Chukharev-Hudilainen E., Saricaoglu A., Torrance M., Feng H.H. (2019). Combined deployable keystroke logging …
  9. Conijn R., Dux Speltz E., van Zaanen M., Van Waes L., Chukharev-Hudilainen E. (2020). A process-oriented data…
  10. Crawford L., Lloyd S., Knoth K. (2008). Analysis of student revisions on a state writing test. Assessment for…
  11. Damerau F. J. (1964). A technique for computer detection and correction of spelling errors. Communications of…
  12. Daxenberger J., Gurevych I. (2012). A corpus-based study of edit categories in featured and non-featured Wiki…
  13. Daxenberger J., Gurevych I. (2013). Automatically classifying edit categories in Wikipedia revisions. In Proc…
  14. College Composition and Communication
  15. Figueredo L., Varnhagen C. K. (2006). Spelling and grammar checkers: Are they intrusive? British Journal of E…
  16. Fitzgerald J. (1987). Research on revision in writing. Review of Educational Research, 57(4), 481-506. https:…
  17. College Composition and Communication
  18. College Composition and Communication
  19. 10.1163/9789004392526_015
  20. Cognitive processes in writing
  21. Advances in applied psycholinguistics: Reading, writing, and language learning
  22. Kollberg P. (1996, October 23-25). S-notation as a tool for analysing the episodic structure of revisions [Pa…
  23. Content analysis: An introduction to its methodology
  24. Krippendorff K. (2011). Computing Krippendorff’s alpha-reliability [Working paper]. https://repository.upenn.…
  25. Leijten M., Van Horenbeeck E., Van Waes L. (2019). Analysing keystroke logging data from a linguistic perspec…
  26. Journal of Writing Research
  27. Limpo T., Alves R. A., Fidalgo R. (2014). Children’s high-level writing skills: Development of planning and r…
  28. Computer keystroke logging and writing: Methods and applications (studies in writing)
  29. Computer keystroke logging and writing: Methods and applications (studies in writing)
  30. Lindgren E., Westum A., Outakoski H., Sullivan K. P. H. (2019). Revising at the leading edge: Shaping ideas o…
  31. Min H.T. (2006). The effects of trained peer review on EFL students’ revision types and writing quality. Jour…
  32. Research in the Teaching of English
  33. Research on composing: Points of departure
  34. Ranalli J., Feng H.H., Chukharev-Hudilainen E. (2018). The affordances of process-tracing technologies for su…
  35. Révész A., Kourtali N.E., Mazgutova D. (2017). Effects of task complexity on L2 writing behaviors and linguis…
  36. The psychology of written language: Developmental and educational perspectives
  37. Sengupta S. (2000). An investigation into the effects of revision strategy instruction on L2 secondary school…
  38. Severinson-Eklundh K., Kollberg P. (2001). Studying writers’ revision patterns with S-notation analysis. In O…
  39. College Composition and Communication
  40. Stevenson M., Schoonen R., de Glopper K. (2006). Revising in two languages: A multi-dimensional comparison of…
  41. Thorson H. (2000). Using the computer to compare foreign and native language writing processes: A statistical…
  42. Tillema M., van den Bergh H., Rijlaarsdam G., Sanders T. (2011). Relating self reports of writing behaviour a…
  43. Van Waes L., Schellens P. J. (2003). Writing profiles: The effect of the writing mode on pausing and revision…
  44. Journal of Writing Research
  45. Verbert K., Govaerts S., Duval E., Santos J. L., Assche F., Parra G., Klerkx J. (2014). Learning dashboards: …
  46. Wengelin Å. (2007). The word-level focus in text production by adults with reading and writing difficulties. …
  47. Computer writing environments: Theory, research, and design
  48. Winder R., Kathpalia S. S., Koo S. L. (2016). Writing centre tutoring sessions: Addressing students’ concerns…
  49. Wobbrock J. O., Myers B. A. (2006). Analyzing the input stream for character-level errors in unconstrained te…
  50. Xu C. (2018). Understanding online revisions in L2 writing: A computer keystroke-log perspective. System, 78(…
  51. Xue H., Hwa R. (2014, June 23-25). Improved correction detection in revised ESL sentences. In Proceedings of …
  52. Zhang F., Hwa R., Litman D., Hashemi H. B. (2016, June 12-17). ArgRewrite: A web-based revision assistant for…
  53. Zhang F., Litman D. (2015). Annotation and classification of argumentative writing revisions. In Proceedings …
  54. Zhang M., Hao J., Li C., Deane P. (2016). Classification of writing patterns using keystroke logs. In van der…
  55. Zhu M., Zhang M., Deane P. (2019). Analysis of keystroke sequences in writing logs. ETS Research Report Serie…