UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

How humans impair automated deception detection performance

Kleinberg, B; Verschuere, B; (2021) How humans impair automated deception detection performance. Acta Psychologica , 213 , Article 103250. 10.1016/j.actpsy.2020.103250. Green open access

[thumbnail of 1-s2.0-S0001691820305746-main.pdf]
1-s2.0-S0001691820305746-main.pdf - Published version

Download (911kB) | Preview


Background: Deception detection is a prevalent problem for security practitioners. With a need for more large-scale approaches, automated methods using machine learning have gained traction. However, detection performance still implies considerable error rates. Findings from different domains suggest that hybrid human-machine integrations could offer a viable path in detection tasks. / Method: We collected a corpus of truthful and deceptive answers about participants' autobiographical intentions (n = 1640) and tested whether a combination of supervised machine learning and human judgment could improve deception detection accuracy. Human judges were presented with the outcome of the automated credibility judgment of truthful or deceptive statements. They could either fully overrule it (hybrid-overrule condition) or adjust it within a given boundary (hybrid-adjust condition). / Results: The data suggest that in neither of the hybrid conditions did the human judgment add a meaningful contribution. Machine learning in isolation identified truth-tellers and liars with an overall accuracy of 69%. Human involvement through hybrid-overrule decisions brought the accuracy back to chance level. The hybrid-adjust condition did not improve deception detection performance. The decision-making strategies of humans suggest that the truth bias - the tendency to assume the other is telling the truth - could explain the detrimental effect. / Conclusions: The current study does not support the notion that humans can meaningfully add the deception detection performance of a machine learning system. All data are available at https://osf.io/45z7e/.

Type: Article
Title: How humans impair automated deception detection performance
Open access status: An open access version is available from UCL Discovery
DOI: 10.1016/j.actpsy.2020.103250
Publisher version: https://doi.org/10.1016/j.actpsy.2020.103250
Language: English
Additional information: Copyright © 2020 The Author(s). Published by Elsevier B.V. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
Keywords: Deception detection, Machine learning, Decision-making, Truth bias, Deceptive intentions
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Security and Crime Science
URI: https://discovery.ucl.ac.uk/id/eprint/10120129
Downloads since deposit
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item