Insights from lexical and syntactic analyses of a French for academic purposes assessment

Randy Appel Waseda University ; Angel Arias Carleton University ; Beverly Baker University of Ottawa ; Guillaume Loignon Université du Québec à Montréal

Abstract

With the objective of improving writing assessment of language instruction, we examine the lexical and syntactic features in two corpora of high and low scoring French texts of the Test du Certificat de Compétence en Langue Seconde (Second Language Certification Test; TCCLS) at the University of Ottawa (uOttawa). We first situate the test in its local context, demonstrating how our research objectives are born from specific needs to improve student outcomes. We then describe our creation of two corpora of high and low performing test takers, followed by lexical bundle (LB) analyses (Phase 1) and further linguistic complexity analyses with a French-language tool (Phase 2). Results indicate that high level writers used more LBs and borrowed more text from the prompt than low level writers. In addition, specific elements of linguistic complexity were identified, suggesting high level writers produced texts that were lexically richer and more syntactically advanced. We discuss the importance of these findings in improving our writing instruction, as well as the challenges of adapting tools and approaches traditionally associated with English to French.

Journal
Assessing Writing
Published
2023-10-01
DOI
10.1016/j.asw.2023.100789
CompPile
Search in CompPile ↗
Open Access
OA PDF Hybrid
Topics
Export

Citation Context

Cited by in this index (0)

No articles in this index cite this work.

References (75) · 5 in this index

  1. Recurrent word combinations in academic writing by native and non-native speakers of Engl…
    English for Specific Purposes  
  2. The growth of complexity and accuracy in L2 French
    Dimensions of L2 performance and proficiency: Complexity, accuracy and fluency in SLA
  3. Lexical bundles in L2 English academic texts: Relationships with holistic assessments of …
    System  
  4. Recurrent word combinations in EAP test-taker writing: Differences between high- and low-…
    Language Assessments Quarterly  
  5. Transitional probability predicts native and non-native use of formulaic language
    International Journal of Applied Linguistics  
Show all 75 →
  1. L1 differences in L2 English academic writing: A lexical bundles analysis
    Journal of English for Academic Purposes  
  2. Assessing Writing
  3. The control of the false discovery rate in multiple testing under dependency
    The Annals of Statistics  
  4. Effect size: Estimation of effect size indices and standardized parameters
    Journal of Open Source Software  
  5. Getting rid of the Chi-square and log-likelihood tests for analysing vocabulary differenc…
    Quaderns Délelőtt Filologia: Estudis Linguistics  
  6. Lexical bundles in university spoken and written registers
    English for Specific Purposes  
  7. If you look at…: Lexical bundles in university teaching and textbooks
    Applied Linguistics  
  8. Longman Grammar of Spoken and Written English
  9. Formulaic sequences and perceived oral proficiency: Putting a lexical approach to the test
    Language Teaching Research  
  10. Lexical bundles in L1 and L2 academic writing
    Language Learning & Technology  
  11. Investigating criterial discourse features across second language development: Lexical bu…
    Applied Linguistics
  12. Statistical Power Analysis for the Behavioral Sciences
  13. Conference on College Composition and Communication (2022). Writing assessment: A position statement. Retriev…
  14. Lexical bundles in published and student disciplinary writing: Examples from history and …
    English for Specific Purposes  
  15. Journal of Writing Research
  16. Predicting second language writing proficiency: The roles of cohesion and linguistic soph…
    Journal of Research in Reading  
  17. Comparing count-based and band-based indices of word frequency: Implications for active v…
    System  
  18. A linguistic analysis of simplified and authentic texts
    The Modern Language Journal  
  19. Assessing Writing
  20. The development of morphological complexity: A cross-linguistic study of L2 French and English
    Second Language Research  
  21. Local language testing: Design, implementation, and development
  22. Understanding development and proficiency in writing: Quantitative corpus linguistics approaches
  23. Using conventional sequences in L2 French
    International Journal of Applied Linguistics in Language Teaching
  24. Forsberg, F., & Bartning, I. (2010). Can linguistic features discriminate between the communicative CEFR-leve…
  25. Vocabulary aspects of advanced L2 French: Do lexical formulaic sequences and lexical rich…
    Language, Interaction and Acquisition  
  26. Beyond advanced stages in high-level spoken L2 French
    Journal of French Language Studies  
  27. When readability meets computational linguistics: A new paradigm in readability. Revue Fr…
    Vol XX
  28. François, T., & Fairon, C. (2012). An “AI readability” formula for French as a foreign language. Proceedings …
  29. Gabrielatos, C. (n.d.). DIFF_FAQ. Retrieved August, 2022. Retrieved from 〈https://ucrel.lancs.ac.uk/ll/DIFF_F…
  30. Gabrielatos, C., & Marchi, A. (2012, September 13–14). Keyness: Appropriate metrics and practical issues. Cri…
  31. Coh-Metrix: Analysis of text cohesions and language
    Behavior Research Methods, Instruments, & Computers  
  32. Granger, S. (2016). A lexical bundle approach to comparing languages: Stems in English and French. In M.-A. L…
  33. Using computer-tagged linguistic features to describe L2 writing differences
    Journal of Second Language Writing  
  34. Conversion et améliorations de corpus du français annotés en Universal Dependencies
    Association pour Lengyel Traitement Automatique des Langues
  35. The development of complexity, accuracy and fluency in the written production of L2 French
    Dimensions of L2 performance and proficiency: Complexity, accuracy and fluency in SLA
  36. Assessing Writing
  37. An introduction to variable and feature selection
    Journal of Machine Learning Research
  38. As can be seen: Lexical bundles and disciplinary variation
    English for Specific Purposes  
  39. Predicting second language writing proficiency in learner texts using computational tools
    Journal of Asia TEFL
  40. Psychologists should use Brunner-Munzel’s instead of mann-whitney’s u test as the default…
    Advances in Methods and Practices in Psychological Science  
  41. Assessing Writing
  42. Automatically assessing lexical sophistication: Indices, tools, findings, and application
    TESOL Quarterly  
  43. A guide to doing statistics in second language research using SPSS and R
  44. Automated scoring of junior and senior high essays using Coh-Metrix features: Implication…
    Language Testing  
  45. MANULEX: A grade-level lexical database from French elementary school readers
    Behavior Research Methods, Instruments, & Computers  
  46. “To whome it may concern”: A study on the use of lexical bundles in email writing tasks i…
    TESL Canada Journal  
  47. Investigating lexical progression through lexical diversity metrics in a corpus of French L3
    Discours
  48. ALSI : un nouvel outil d’analyse automatisée de la complexité linguistique pour le frança…
    Mesure et évaluation en éducation  
  49. Automatic analysis of syntactic complexity in second language writing
    International Journal of Corpus Linguistics  
  50. A corpus‐based evaluation of syntactic complexity measures as indices of college‐level ES…
    TESOL Quarterly  
  51. McCarthy, P.M., Lewis, G.A., Dufty, D.F., & McNamara, D.S. (2006). Analyzing writing styles with Coh-Metrix. …
  52. La richesse lexicale des productions orales: Mesure fiable du niveau de compétence langagière
    The Canadian Modern Language Review  
  53. Methodological issues in contrastive lexical bundle research: The influence of corpus des…
    International Journal of Corpus Linguistics  
  54. Phraseological competence: A missing component in university entrance language tests? Ins…
    Language Assessment Quarterly  
  55. Pawley, A., & Syder, F.H. (1983). Two puzzles for linguistic theory: Nativelike selection and nativelike flue…
  56. How big is “big”? Interpreting effect sizes in L2 research
    Language Learning  
  57. From key words to key semantic domains
    International Journal of Corpus Linguistics  
  58. Comparing corpora using frequency profiling
    Proceedings of the Workshop on Comparing Corpora, held in conjunction with the 38th Annual Meeting of the Association for Computational Linguistics
  59. An investigation of the lexical dimension of the IELTS speaking test
    IELTS Research Reports
  60. Scott, M. (2020). WordSmith tools version 8. Lexical Analysis Software.
  61. Do native writers always have a head start over nonnative writers? The use of lexical bun…
    Journal of English for Academic Purposes  
  62. An exploration of L2 teachers’ use of pedagogical interventions devised to draw L2 learne…
    Language Learning  
  63. An academic formulas list: New methods in phraseology research
    Applied Linguistics  
  64. ÉQOL: Une nouvelle base de données québécoise du lexique scolaire du primaire comportant …
    Corpus
  65. Formulaic sequences and EAP writing development: Lexical bundles in the TOEFL iBT writing…
    Journal of English for Academic Purposes  
  66. UDPipe: Trainable pipeline for processing CoNLL-U files performing tokenization, morpholo…
    Proceedings of the 10th International Conference on Language Resources and Evaluation
  67. J’ai l’impression que: Lexical bundles in the dialogues of beginner French textbooks
    Canadian Journal of Applied Linguistics  
  68. Applying phraseological complexity measures to L2 French: A partial replication study
    International Journal of Learner Corpus Research  
  69. Use of lexical features in non-native academic writing
    Journal of Second Language Writing  
  70. Wen, Q., Wang, L., & Liang, M. (2005). Spoken and written English corpus of Chinese learners. Foreign Languag…