Abnormal behavior recognition using SRU with attention mechanism

Tay, Nian Chi, Connie, Tee, Ong, Thian Song, Teoh, Andrew Beng Jin and Teh, Pin Shen ORCID: https://orcid.org/0000-0002-0607-2617 (2024) Abnormal behavior recognition using SRU with attention mechanism. International Journal of Advances in Intelligent Informatics, 10 (2). pp. 202-219. ISSN 2442-6571

Preview

Published Version Available under License Creative Commons Attribution Share Alike. Download (1MB) | Preview

Abstract

In response to the critical need for enhanced public safety measures, this study introduces an advanced intelligent surveillance system designed to autonomously detect abnormal behaviors within public spaces. Leveraging the computational efficiency and accuracy of a Simple Recurrent Unit (SRU) integrated with an attention mechanism, this research delivers a novel approach towards understanding and interpreting human interactions in real-time video footage. Distinctively, the model specializes in identifying two primary categories of abnormal behavior: aggressive two-person interactions such as physical confrontations and collective crowd dynamics, characterized by sudden dispersal patterns indicative of distress or danger. The incorporation of Attention mechanism precisely targets critical elements of behavior, thereby enhancing the model's focus and interpretative clarity. Empirical validation across five benchmark datasets reveals that our model not only outperforms traditional Long Short-Term Memory (LSTM) frameworks in terms of speed by a factor of 1.5 but also demonstrates superior accuracy in abnormal behavior recognition. These findings not only underscore the model's potential in preempting potential safety threats but also mark a significant advancement in the application of deep learning technologies for public security infrastructures. This research contributes to the broader discourse on public safety, offering actionable insights and robust technological solutions to enhance surveillance efficacy and response mechanisms in critical public domains.