Toward a Greater Understanding of the Use of Nonverbal Cues To Deception in Computer-Mediated Communication

Joey F. George Iowa State University ; Annette M. Mills ; Gabriel Giordano Ohio University ; Manjul Gupta Florida International University ; Vanesa M. Tennant ; Carmen C. Lewis

Abstract

<bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Background:</b> Computer-mediated communication (CMC) is an important part of work life. However, this communication can be dishonest, and when people attempt to judge dishonesty, irrespective of the cues available, they tend to rely on a few nonverbal cues that are not the most reliable. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Literature review:</b> According to leakage theory, CMC modes differ from each other in the number of cues to deception they can transmit, potentially affecting one's ability to detect deception in a given medium. There is considerable research on peoples’ use of nonverbal cues across CMC modes to evaluate deception, but limited understanding of the choices they make and the extent to which their deception judgments are impaired or helped by cues they have access to for different CMC modes. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Research questions:</b> 1. To what extent are the nonverbal cues that people say they rely on to detect deception shaped by the medium that they use for communication? 2. What are the effects of nonverbal cue availability on deception detection success? <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Methodology:</b> We conducted an experiment with 132 veracity judges from New Zealand and Jamaica, who observed interview segments in Spanish and Hindi (languages that they did not understand) to isolate the effects of nonverbal cues. They determined the veracity of each segment and listed the things that guided their judgment. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Results/discussion:</b> The results suggest that when certain nonverbal cues are available, such as gaze aversion, these suppress attention to more reliable cues (e.g., voice pitch) when judging deception. Redirecting attention to more reliable cues is therefore important. Unexpectedly, cue choice also varied across language by medium. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Conclusions:</b> The findings extend the understanding of people's use of nonverbal cues and the extent to which certain cues distract in the deception judgment. Although people rely on vocalic cues in audio-only media and kinesic cues in video-only media, they tend to rely mostly on, and are distracted by, a few kinesic cues for full audiovisual media, even though vocalic cues are available. We also found that people can successfully detect cues to deception, even when their communication mode is relatively bereft of useful information. However, the availability (or lack) of nonverbal cues was not a factor in deception detection success. To improve detection, deception training that targets reliable cues for different media is needed.

Journal
IEEE Transactions on Professional Communication
Published
2023-06-01
DOI
10.1109/tpc.2023.3263378
CompPile
Open Access
Closed
Topics
Export

Citation Context

Cited by in this index (0)

No articles in this index cite this work.

References (49) · 2 in this index

  1. 10.25300/MISQ/2018/13215
  2. 10.1007/s10919-014-0179-z
  3. 10.1002/jip.1543
  4. 10.1080/00332747.1969.11023575
  5. 10.1109/HICSS.2003.1173792
Show all 49 →
  1. 10.1080/01463373.2017.1298637
  2. 10.1177/0022022105282295
  3. 10.1371/journal.pone.0156615
  4. 10.1080/10683160308138
  5. 10.1037/0021-9010.89.1.137
  6. 10.1016/j.copsyc.2022.101380
  7. 10.18290/rh21696s-9
  8. 10.1016/j.eswa.2020.114341
  9. 10.1371/journal.pone.0254960
  10. 10.1002/acp.2990
  11. 10.1177/0146167200265010
  12. 10.1146/annurev-psych-010418-103135
  13. 10.1093/jcmc/zmz018
  14. 10.4088/PCC.09r00780
  15. 10.1207/s15327957pspr1003_2
  16. 10.1111/j.1468-2885.1996.tb00127.x
  17. 10.1177/0093650213485785
  18. 10.1145/985692.985709
  19. 10.1037/0022-3514.70.5.979
  20. Is your company hiring Charlatans? A study of ethical standards in the hiring process
  21. IEEE Transactions on Professional Communication
  22. 10.1007/BF00996226
  23. 10.1007/s10726-009-9169-7
  24. 10.1016/j.chb.2014.02.027
  25. 10.1007/BF02173410
  26. 10.1016/j.obhdp.2008.02.002
  27. 10.1111/j.1468-2958.2008.00333.x
  28. The impact of presentation modality on perceptions of truthful and deceptive confessions
    Criminologie
  29. IEEE Transactions on Professional Communication
  30. Detecting deception in face to face and computer mediated conversations
  31. Microsoft teams: Number of daily active users 2019&#x2013;2022
  32. Zoom user statistics: How many people use zoom in 2023?
  33. To catch a liar: A cross-cultural comparison of computer-mediated deceptive communication
  34. 10.3389/fpsyg.2016.01771
  35. 10.4324/9781003095552
  36. 10.1080/1068316X.2010.535820
  37. Seeing isn't required to gesture like a native speaker
  38. 10.1146/annurev-psych-113011-143802
  39. 10.1037/0033-2909.129.1.74
  40. Duped Truth-Default Theory and the Social Science of Lying and Deception
  41. 10.1177/0261927X14535916
  42. 10.2307/25148857
  43. Nonverbal bilingualism: Deaf schemas of deception
  44. 10.1016/j.jarmac.2021.06.002