Abstract

This paper examines ChatGPT's use of evaluative language and engagement strategies while addressing information-seeking queries. It assesses the chatbot's role as a virtual teaching assistant (VTA) across various educational settings. By employing Appraisal theory, the analysis contrasts responses generated by ChatGPT and those added by humans, focusing on the interactants’ attitude, deployment of interpersonal metaphors and evaluations of entities, revealing their views on Australian cultural practice. Two datasets were analysed: the first sample (15,909 words) was retrieved from the subreddit r/AskAnAustralian and the second (10,696 words) was obtained by prompting ChatGPT with the same questions. The findings show that, while human experts mainly opt for subjective explicit formulations to express personal viewpoints, the chatbot's preference goes out to incongruent ‘it is’-constructions to share pre-programmed perspectives, which may reflect ideological bias. Even though ChatGPT displays promising socio-communicative capabilities (SCs), its lack of contextual awareness, required to function cross-culturally as a VTA, may lead to considerable ethical issues. The study's novel contribution lies in the in-depth investigation of how the chatbot's SCs and lexicogrammatical selections may impact its role as a VTA, highlighting the need to develop students’ critical digital literacy skills while using AI learning tools.

Journal
Computers and Composition
Published
2024-09-01
DOI
10.1016/j.compcom.2024.102871
CompPile
Open Access
OA PDF Hybrid
Topics
Export

Citation Context

Cited by in this index (2)

  1. Computers and Composition
  2. Computers and Composition

References (131) · 1 in this index

  1. Revolutionizing education with AI: Exploring the transformative potential of ChatGPT
    Contemporary Educational Technology  
  2. The potential of chatbots: Analysis of chatbot conversations
    2019 IEEE 21st conference on business informatics (CBI)
  3. ChatGPT as an educational tool: Opportunities, challenges, and recommendations for commun…
    Journal of Artificial Intelligence and Technology
  4. Impact of ChatGPT on learning motivation
    Journal of English Studies in Arabia Felix  
  5. AI and ChatGPT in language teaching: Enhancing EFL classroom support and transforming ass…
    International Journal of Higher Education Pedagogies  
Show all 131 →
  1. Dialogic imagination: Four essays
  2. Big data's disparate impact
    California Law Review
  3. Assessing Writing
  4. Emotion talk across corpora
  5. Dimensions of evaluation: Cognitive and linguistic perspectives
    Pragmatics & Cognition  
  6. Coexistence and creativity: Screen media education in the age of artificial intelligence …
    Media Practice and Education
  7. A computer wrote this paper: What ChatGPT means for education, research, and writing
    SSRN  
  8. Affordance analysis – matching learning tasks with learning technologies
    Educational Media International  
  9. Technology-mediated learning theory
    British Journal of Educational Technology  
  10. Language models are few-shot learners
    Advances in Neural Information Processing Systems
  11. Sparks of artificial general intelligence: Early experiments with GPT–4
  12. MLA–CCCC Joint Task Force on Writing and AI Working Paper: Overview of the Issues, Statement of Principles, and Recommendations
  13. Semantics derived automatically from language corpora contain human-like biases
    Science  
  14. Towards intelligent-TPACK: An empirical study on teachers’ professional knowledge to ethi…
    Computers in Human Behavior  
  15. A comprehensive AI policy education framework for university teaching and learning
    Int J Educ Technol High Educ  
  16. Students’ voices on generative AI: Perceptions, benefits, and challenges in higher education
    International Journal of Educational Technology in Higher Education  
  17. This new conversational AI model can be your friend, philosopher, and guide … and even yo…
    Pattern  
  18. Artificial intelligence (AI) student assistants in the classroom: Designing chatbots to s…
    Information Systems Frontiers  
  19. ChatGPT goes to law school
    Minnesota Legal Studies Research Paper No. 23–03
  20. Assessment of the capacity of ChatGPT as a self-learning tool in medical pharmacology: A …
    BMC Med Educ  
  21. Indigenous spirit and ghost folklore of “settled” Australia
    Folklore  
  22. Examining science education in ChatGPT: An exploratory study of generative artificial int…
    Journal of Science Education and Technology  
  23. Chatting and cheating: Ensuring academic integrity in the era of ChatGPT
    Innovations in Education and Teaching International
  24. How artifacts afford: The power and politics of everyday things
  25. Dey, A. (13 November 2019). Story of Cleverbot and Rollo Carpenter. Retrieved from https://www.yourtechstory.…
  26. EduChat: An AI-based chatbot for university-related information using a hybrid approach
    Applied Sciences  
  27. Introducing Duolingo Max, a learning experience powered by GPT-4
    Duolingo Blog
  28. Erickson, K. (10 April 2023). What a precursor to ChatGPT taught us about AI – in 1966. Retrieved from https:…
  29. The role of ChatGPT, generative language models, and artificial intelligence in medical e…
    JMIR Medical Education  
  30. Extance, A. (15 November 2023). ChatGPT has entered the classroom: How LLMs could transform education. Retrie…
  31. Prompting large language models to power educational chatbots
    Advances in web-based learning – ICWL 2023. ICWL 2023. Lecture Notes in Computer Science, vol 14409
  32. A SWOT analysis of ChatGPT: Implications for educational practice and research
    Innovations in Education and Teaching International
  33. Analysing the role of ChatGPT in improving student productivity in higher education
    Journal on Education  
  34. Mathematical capabilities of ChatGPT
  35. Bias in computer systems
    ACM Transactions on Information Systems (TOIS)  
  36. ChatGPT: Roles and boundaries of the new artificial intelligence tool in medical educatio…
    Annals of Medicine & Surgery  
  37. Geerling, W., Mateer, G.D., Wooten, J., & Damodaran, N. (2023). Is ChatGPT smarter than a student in principl…
  38. The ecological approach to visual perception
  39. Attitude of college students towards ethical issues of artificial intelligence in an inte…
    AI & Soc  
  40. The notion of “context” in language education
    Language and education: Volume 9 in the collective works of MAK Halliday
  41. An introduction to functional grammar
  42. Hargreaves, S. (2023). Words are flowing out like endless rain into a paper cup: ChatGPT & law school assessm…
  43. Attention is not all you need: the complicated case of ethically using large language mod…
    EBioMedicine  
  44. Multilingual language models are not multicultural: A case study in emotion
  45. Learning in the wild: Coding for learning and practice on Reddit
    Learning, Media and Technology  
  46. ChatGPT and medical education: A double-edged sword
    Journal of Pedagogy and Education Science  
  47. The impact of ChatGPT on foreign language teaching and learning: Opportunities in educati…
    Journal of Educational Technology and Innovation  
  48. spaCy: Industrial–strength Natural Language Processing in Python [Python]
  49. ChatGPT's advice is perceived as better than that of professional advice columnists
    Frontiers in Psychology  
  50. Chatbots for language learning—Are they really useful? A systematic review of chatbot-sup…
    Journal of Computer Assisted Learning  
  51. Phraseology and system: A contribution to the debate
    System and Corpus: Exploring Connections
  52. A local grammar of evaluation
    Evaluation in text: Authorial stance and the construction of discourse
  53. Hooking the reader: A corpus study of evaluative that in abstracts
    English for Specific Purposes  
  54. Perception, performance, and detectability of conversational artificial intelligence acro…
    Scientific Reports  
  55. Game of algorithms: ChatGPT implications for the future of tourism education and research
    Journal of Tourism Futures  
  56. The ethics of artificial intelligence and robotization in tourism and hospitality - A con…
    Journal of Smart Tourism
  57. Integrating ChatGPT in medical education: Adapting curricula to cultivate competent physi…
    Cureus
  58. Unlocking the opportunities through ChatGPT tool towards ameliorating the education system
    BenchCouncil Transactions on Benchmarks Standards and Evaluations  
  59. Large language models in education: A focus on the complementary relationship between hum…
    Education and Information Technologies  
  60. ChatGPT in action: Harnessing artificial intelligence potential and addressing ethical ch…
    World Journal of Methodology  
  61. Johnson, R.L., Pistilli, G., Menédez-González, N., Duran, L.D.D., Panai, E., Kalpokiene, J., & Bertulfo, D.J.…
  62. The need for health AI ethics in medical school education
    Advances in Health Sciences Education  
  63. ChatGPT—A challenging tool for the university professors in their teaching practice
    Education Sciences  
  64. ChatGPT: Jack of all trades, master of none
    Information Fusion  
  65. ChatGPT for language teaching and learning
    RELC Journal  
  66. Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large …
    PLOS Digital Health  
  67. ChatGPT for good? On opportunities and challenges of large language models for education
    Learning and Individual Differences  
  68. Harnessing GPT-4 so that all students benefit. A nonprofit approach for equal access!
    Khan Academy Blog
  69. What is contextual intelligence?
    Contextual Intelligence
  70. Master's thesis
  71. The rise of ChatGPT: Exploring its potential in medical education
    Anatomical Sciences Education
  72. Generative AI and the future of education: Ragnarok or Reformation? A paradoxical perspec…
    The International Journal of Management Education  
  73. Dialogue, dialogicality and interactivity: A conceptually bewildering field?
    Language and Dialogue  
  74. Linguistic semantics: An introduction
  75. War and its ideologies: A social-semiotic theory and description
  76. ChatGPT and a new academic reality: Artificial Intelligence-written research papers and t…
    Journal of the Association for Information Science and Technology  
  77. Metaphors we feel by: Stratal tension
    Journal of World Languages  
  78. The language of evaluation: Appraisal in English
  79. Ethical use of artificial intelligence in health professions education: AMEE Guide No. 158
    Medical Teacher  
  80. Affordances: clarifying and evolving a concept, proceedings of Graphics Interface 2000
  81. FinTech and artificial intelligence for sustainable development: The role of smart technologies in achieving development goals
  82. Exploring the potential of using an AI language model for automated essay scoring
    SSRN Electronic Journal
  83. Exploring user perspectives on ChatGPT: Applications, perceptions, and implications for AI-integrated education
  84. The uselessness of AI ethics
    AI Ethics  
  85. Ethical principles for artificial intelligence in education
    Educ Inf Technol  
  86. Is ChatGPT a good tool for T&CM students in studying pharmacology?
    SSRN  
  87. The psychology of everyday things
  88. ChatGPT: Should it have a role in education?
    Creative approaches to technology-enhanced learning for the workplace and higher education. TLIC. Lecture Notes in Networks and Systems, Vol. 767
  89. DALL·E: Creating images from text
  90. ChatGPT: Optimizing language models for dialogue
  91. Our approach to AI safety
  92. ChatGPT
  93. Is ChatGPT biased?
  94. Training language models to follow instructions with human feedback
    Advances in Neural Information Processing Systems
  95. Education in 2051
    Artificial intelligence, human agency and the educational leader
  96. Personalized adaptive learning: an emerging pedagogical approach enabled by a smart learn…
    Smart Learning Environments  
  97. Academic integrity considerations of AI Large Language Models in the post- pandemic era: …
    Journal of University Teaching & Learning Practice  
  98. A study of dialogic expansion and contraction in spoken discourse using corpus and experi…
    Corpora  
  99. Engineering education in the era of ChatGPT: Promise and pitfalls of generative AI for ed…
    2023 IEEE Global Engineering Education Conference (EDUCON)
  100. ChatGPT for education and research: Opportunities, threats, and strategies
    Applied Sciences  
  101. The role of ChatGPT in higher education: Benefits, challenges, and future research directions
    Journal of Applied Learning and Teaching
  102. AI writing assistants can cause biased thinking in their users
    Ars Technica
  103. ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics…
    Internet of Things and Cyber-Physical Systems
  104. ChatGPT: Empowering lifelong learning in the digital age of higher education
    Educ Inf Technol
  105. ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?
    Journal of Applied Learning and Teaching
  106. Tree-based representation and generation of natural and mathematical language
  107. Can students without prior knowledge use ChatGPT to answer test questions? An empirical study
    ACM Transactions on Computing Education  
  108. Twenty years ago, AIM chatbot SmarterChild out-snarked ChatGPT
  109. Reversing the threat of artificial intelligence to opportunity: A discussion of ChatGPT i…
    Journal of Teaching in Travel & Tourism  
  110. ChatGPT in higher education: Considerations for academic integrity and student learning
    Journal of Applied Learning and Teaching
  111. Swift, J. (1765). Travels into several remote nations of the world...: By Lemuel Gulliver, First a surgeon, a…
  112. Artificial cognition: How experimental psychology can help generate explainable artificia…
    Psychon Bull Rev  
  113. What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education
    Smart Learning Environments  
  114. Framework for a foreign language teaching software for children utilizing AR, voicebots a…
    The Journal of Cognitive Systems  
  115. COVID-19 vaccine hesitancy and shaming on TikTok: A multimodal appraisal analysis
    Multimodality & Society  
  116. Lockdown scepticism: Australian and American doom discourse on Reddit
    Studies in Communication Sciences
  117. Do not parade your ignorance: Negation as a power tool of toxic geek masculinity
    SN Social Sciences  
  118. The ethics of AI assisted learning: A systematic literature review on the impacts of Chat…
    Proceedings of the 2023 8th International Conference on Distance Education and Learning
  119. Subjective and objective modality: Interpersonal and ideational functions in the English …
    Journal of Pragmatics  
  120. Dialogue and inter–subjectivity: Reinterpreting the semantics of modality and hedging
    Dialogue Analysis VII: working with dialogue: selected papers from the 7th IADA Conference, Birmingham
  121. Beyond modality and hedging: A dialogic view of the language of intersubjective stance
    Text & Talk
  122. Evaluative semantics and ideological positioning in journalistic discourse
    Mediating ideology in text and image  
  123. Taking Bakhtin seriously: Dialogic effects in written, mass communicative discourse
    Japanese Journal of Pragmatics
  124. Investigating the role of ChatGPT in supporting text-based programming education for stud…
    Informatics in Schools. Beyond Bits and Bytes: Nurturing Informatics Intelligence in Education. ISSEP 2023. Lecture Notes in Computer Science, vol 14296
  125. Impact of ChatGPT on learners in a L2 writing practicum: An exploratory investigation
    Educ Inf Technol  
  126. Personalizing dialogue agents: I have a dog, do you have pets too?
    Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics