Automated deception detection of males and females from non-verbal facial micro-gestures

Crockett, Keeley ORCID: https://orcid.org/0000-0003-1941-6201, O'Shea, Jim ORCID: https://orcid.org/0000-0001-5645-2370 and Khan, Wasiq (2020) Automated deception detection of males and females from non-verbal facial micro-gestures. In: IEEE World Congress on Computational Intelligence - IJCNN 2020, 19 July 2020 - 24 July 2020, Glasgow, UK (virtual congress).

Preview

Accepted Version Available under License In Copyright. Download (730kB) | Preview

Abstract

Gender bias within Artificial intelligence driven systems is currently a hot topic and is one of a number of areas where the data used to train, validate and test machine learning algorithms is under more scrutiny than ever before. In this paper we investigate if there is a difference between the non-verbal cues to deception generated by males and females through the use of an automated deception detection system. The system uses hierarchical neural networks to extract 36 channels of non-verbal head and facial behaviors whilst male and female participants are engaged in either a deceptive or truthful roleplaying task. An Image Vector dataset, comprising of 86584 vectors, is collated which uses a fixed sliding window slot of 1 second to record deceptive or truthful slots. Experiments were conducted on three variants of the dataset, all males, all females and mixed in order to examine if the differences in cues generated by males and females lead to differences in the accuracies of machine learning algorithms which classify their behavior. Results showed differences in non-verbal cues between males and females, with both genders at a disadvantage when treated by classifiers trained on both genders rather than classifiers specifically trained for each gender. However, there was no striking disadvantageous effect beyond the influence of their relative frequency of occurrence in the dataset.