High-Stakes English-Language Assessments for Aviation Professionals: Supporting the Use of a Fully Automated Test of Spoken-Language Proficiency

Ryan Downey Pearson (United States) ; Masanori Suzuki Pearson (United States) ; Alistair Van Moere Pearson (United States)

Abstract

A recent International Civil Aviation Organization initiative mandates that pilots and air-traffic controllers operating on international routes demonstrate adequate English-language proficiency for successful communication. The Versant Aviation English Test was developed to serve this purpose. It is a fully automated speaking and listening performance test, where administration of the test tasks and scoring of the candidates' responses are computerized. We argue that not only do candidates engage in cognitively and linguistically appropriate interactions, but that computer-generated scores and human ratings are consistent (r = 0.94) , enabling valid score-based decisions to be made on the basis of automated language testing.

Journal
IEEE Transactions on Professional Communication
Published
2010-03-01
DOI
10.1109/tpc.2009.2038734
CompPile
Open Access
Closed
Topics
Export

Citation Context

Cited by in this index (0)

No articles in this index cite this work.

References (49)

  1. 10.1016/S0926-6410(02)00198-2
  2. Encyclopedia of Cognitive Science Vol 2 EpilepsyMental Imagery Philosophical Issues About
  3. Measuring Second Language Performance
  4. new provisions for english language proficiency are expected to improve aviation safety
    ICAO J
  5. 10.1016/0346-251X(92)90045-5
Show all 49 →
  1. 10.2307/j.ctt1ckpccf.13
    Language Testing Reconsidered  
  2. 10.7551/mitpress/6393.001.0001
    Speaking From Intention to Articulation  
  3. Standards for Educational and Psychological Testing
  4. A facets model for judgmental scoring Memo 61 MESA Psychometric Laboratory
  5. Facets Rasch Measurement Computer Program
  6. interviewer variability in specific-purpose language performance tests
    Proc LTRC
  7. Fundamental Considerations in Language Testing
  8. 10.1191/0265532203lt242oa
  9. English as a global language
  10. pilot and controller communications issues in
  11. Versant English test Test description and validation summary Pearson Knowledge Technologies Palo Alto CA
  12. Language testing criteria for global harmonization
  13. Final report on a survey of aviation English tests
  14. probing above the ceiling in oral interviews: what's up there?
    Proc LTRC
  15. Language Testing in Practice
  16. Educational Measurement
  17. Test Validity
  18. pronunciation assessment based upon the compatibility between a learner's pronunciation s…
    Proc INTERSPEECH  
  19. automatic intelligibility assessment and diagnosis of critical pronunciation errors for c…
    Proc Int Conf Spoken Language Processing
  20. 10.1073/pnas.231459498
  21. pronunciation evaluation in read and spontaneous speech: a comparison between human ratin…
    Proc New Sounds 4th Int Symp Acquisition of Second-Language Speech
  22. 10.1109/TASL.2006.878255
  23. 10.1121/1.428279
  24. 10.1109/ICASSP.2009.4960712
  25. sensei: spoken language assessment for call center agents
    Proc IEEE Workshop on Automatic Speech Recognition and Understanding
  26. 10.1016/j.specom.2009.03.002
  27. two experiments on automatic scoring of spoken language proficiency
    Proc Integrating Speech Technology in Language Learning
  28. Versant Spanish test Test description and validation summary Pearson Knowledge Technologies Palo Alto CA
  29. Manual on the implementation of the ICAO language proficiency requirements
  30. standards for test development in aviation: from placement to proficiency
    ICAO Aviation Language Symp Montral QC Canada
  31. Context-sensitive speech recognition in the air traffic control simulation EUROCONTROL Experimental Centre (EEC) note no 02/2001
  32. vocal interaction and air traffic management: the voice project
    Int Conf Human-Computer Interaction in Aeronautics Toulouse France
  33. Technical analysis of ATC controller to pilot voice communication with regards to automatic speech recognition systems EUROCONTROL Experimental Centre (EEC) note No 01/2001
  34. concurrent task demands in the cockpit: challenges and vulnerabilities in routine flight …
    Proc 12th Int Symp Aviation Psychology
  35. 10.1080/15434300802606564
  36. 10.1109/ICASSP.1997.596227
  37. The HTK Book Version 2 1
  38. Issues in Language Testing
  39. in the ear of the beholder: dependence of comprehensibility on language background of spe…
    Language Testing Research Colloq Denver CO
  40. 10.1017/CBO9780511733017
  41. Versant aviation English test Test description and validation summary Pearson Knowledge Technologies Palo Alto CA
  42. air traffic communication in a second language: implications of cognitive factors for tra…
    TESOL Quart  
  43. Testing Second Language Speaking
  44. Sentence Repetition Testing for Studies of Community Bilingualism