Vision based intelligent traffic light management system using Faster R-CNN

Abbas, Syed Konain, Khan, Muhammad Usman Ghani, Zhu, Jia ORCID: https://orcid.org/0000-0002-5959-390X, Sarwar, Raheem ORCID: https://orcid.org/0000-0002-0640-807X, Aljohani, Naif R, Hameed, Ibrahim A and Hassan, Muhammad Umair ORCID: https://orcid.org/0000-0001-7607-5154 (2024) Vision based intelligent traffic light management system using Faster R-CNN. CAAI Transactions on Intelligence Technology, 9 (4). pp. 932-947. ISSN 2468-6557

Preview

Published Version Available under License Creative Commons Attribution. Download (1MB) | Preview

Abstract

Transportation systems primarily depend on vehicular flow on roads. Developed countries have shifted towards automated signal control, which manages and updates signal synchronisation automatically. In contrast, traffic in underdeveloped countries is mainly governed by manual traffic light systems. These existing manual systems lead to numerous issues, wasting substantial resources such as time, energy, and fuel, as they cannot make real-time decisions. In this work, we propose an algorithm to determine traffic signal durations based on real-time vehicle density, obtained from live closed circuit television camera feeds adjacent to traffic signals. The algorithm automates the traffic light system, making decisions based on vehicle density and employing Faster R-CNN for vehicle detection. Additionally, we have created a local dataset from live streams of Punjab Safe City cameras in collaboration with the local police authority. The proposed algorithm achieves a class accuracy of 96.6% and a vehicle detection accuracy of 95.7%. Across both day and night modes, our proposed method maintains an average precision, recall, F1 score, and vehicle detection accuracy of 0.94, 0.98, 0.96 and 0.95, respectively. Our proposed work surpasses all evaluation metrics compared to state-of-the-art methodologies.