Adapted Psychological Profiling verses the right to an explainable decision

Crockett, K ORCID: https://orcid.org/0000-0003-1941-6201, Stoklas, J, O’Shea, J, Krügel, T and Khan, W (2018) Adapted Psychological Profiling verses the right to an explainable decision. In: IJCCI 2018 - Proceedings of the 10th International Joint Conference on Computational Intelligence., 18 September 2018 - 20 September 2018, Seville, Spain.

Preview

Available under License In Copyright. Download (568kB) | Preview

Abstract

Copyright 2018 by SCITEPRESS – Science and Technology Publications, Lda. All rights reserved. Adaptive Psychological Profiling is the process of determining a person’s internal mental state through the analysis of a person’s non-verbal behaviour. Silent Talker is a pioneering psychological profiling system which was developed by experts in behavioural neuroscience and computational intelligence. Designed for use in natural conversation, Silent Talker combines image processing and artificial intelligence to classify multiple visible non-verbal signals of the face during verbal communication to produce an accurate and comprehensive time-based profile of a subject’s psychological state. Silent Talker uses a unique configuration of artificial neural networks, hence, it is difficult to understand how the classification of a person’s behaviour is obtained. New legislation in the form of GDPR, now requires individuals whom are automatically profiled, to have the right to an explanation of how the “machine” reached its decision and receive meaningful information on the logic involved. This is difficult in practice, both from a technical and legal point of view. This paper, uses an application of psychological profiling within a pilot system known as iBorderCtrl, which detects deception through an avatar border guard interview during a travellers pre-registration to demonstrate the challenges faced in trying to obtain explainable decisions from models derived through Computational Intelligence techniques.