Development of an early detection and automatic targeting system for cotton weeds using an improved lightweight YOLOv8 architecture on an edge device

Karim, Md Jawadul ORCID: https://orcid.org/0009-0006-4226-3652, Nahiduzzaman, Md, Ahsan, Mominul ORCID: https://orcid.org/0000-0002-7300-506X and Haider, Julfikar ORCID: https://orcid.org/0000-0001-7010-8285 (2024) Development of an early detection and automatic targeting system for cotton weeds using an improved lightweight YOLOv8 architecture on an edge device. Knowledge-Based Systems, 300. 112204. ISSN 0950-7051

Preview

Published Version Available under License Creative Commons Attribution. Download (43MB) | Preview

Abstract

Traditional means of weed removal, such as human work or the use of pesticides, frequently require significant amounts of effort, incur high expenses, and can negatively impact the environment. This study introduces a modified version of the YOLOv8 nano architecture that is suitable for running on edge devices for real-time applications. The proposed model uses an augmented version of the well-known CottonWeedDet12 dataset consisting of a total of 16,944 images with characteristic annotations to develop a model capable of correctly distinguishing 12 different cotton weed classes with an increased mean average precision of 97.6 % that is about 1.2 % more than the model trained using original, unaugmented dataset. The final selected model uses a convolutional block attention module (CBAM) and a unique C3Ghost block within the YOLOv8 backbone, which together increase the model's reliability for more accurate predictions with reduced computational complexity. Upon training with the augmented dataset, the proposed model with only 3.6 million parameters was able to achieve an mAP@50 score of 97.6 %, which surpasses all previous studies conducted using this dataset. Additionally, a high F1 score of 94.4 % proves that the model has a good balance between recall and precision. Class Activation Map (CAM) approaches such as EigenCAM, Grad-CAM++, and LayerCAM explainable AI (XAI) showed promising results for each of the customized models upon testing their interpretability for cotton weed detection. Furthermore, based on this model, a fast and cost-efficient targeting system was developed using a yaw-pitch mechanism for automatic weed tracking and herbicide spraying.