Classification of pest-damaged coniferous trees in unmanned aerial vehicles images using convolutional neural network models

Kerchev I.A., Markov N.G., Machuca C.R., Tokareva O.S.
 pdf (10898K)

This article considers the task of multiclass classification of coniferous trees with varying degrees of damage by insect pests on images obtained using unmanned aerial vehicles (UAVs). We propose the use of convolutional neural networks (CNNs) for the classification of fir trees Abies sibirica and Siberian pine trees Pinus sibirica in unmanned aerial vehicles (UAV) imagery. In our approach, we develop three CNN models based on the classical U-Net architecture, designed for pixel-wise classification of images (semantic segmentation). The first model, Mo-U-Net, incorporates several changes to the classical U-Net model. The second and third models, MSC-U-Net and MSC-Res-U-Net, respectively, form ensembles of three Mo-U-Net models, each varying in depth and input image sizes. Additionally, the MSC-Res-U-Net model includes the integration of residual blocks. To validate our approach, we have created two datasets of UAV images depicting trees affected by pests, specifically Abies sibirica and Pinus sibirica, and trained the proposed three CNN models utilizing mIoULoss and Focal Loss as loss functions. Subsequent evaluation focused on the effectiveness of each trained model in classifying damaged trees. The results obtained indicate that when mIoULoss served as the loss function, the proposed models fell short of practical applicability in the forestry industry, failing to achieve classification accuracy above the threshold value of 0.5 for individual classes of both tree species according to the IoU metric. However, under Focal Loss, the MSC-Res-U-Net and Mo-U-Net models, in contrast to the third proposed model MSC-U-Net, exhibited high classification accuracy (surpassing the threshold value of 0.5) for all classes of Abies sibirica and Pinus sibirica trees. Thus, these results underscore the practical significance of the MSC-Res-U-Net and Mo-U-Net models for forestry professionals, enabling accurate classification and early detection of pest outbreaks in coniferous trees.

Keywords: coniferous tree insect pests, Siberian fir Abies sibirica, Siberian pine Pinus sibirica, semantic image segmentation, unmanned aerial vehicle, convolutional neural network U-Net model
Citation in English: Kerchev I.A., Markov N.G., Machuca C.R., Tokareva O.S. Classification of pest-damaged coniferous trees in unmanned aerial vehicles images using convolutional neural network models // Computer Research and Modeling, 2024, vol. 16, no. 5, pp. 1271-1294
Citation in English: Kerchev I.A., Markov N.G., Machuca C.R., Tokareva O.S. Classification of pest-damaged coniferous trees in unmanned aerial vehicles images using convolutional neural network models // Computer Research and Modeling, 2024, vol. 16, no. 5, pp. 1271-1294
DOI: 10.20537/2076-7633-2024-16-5-1271-1294
URL: http://crm-en.ics.org.ru/journal/article/3528/
Creative Commons License This work is licensed under a Creative Commons Attribution-NoDerivs 3.0 Unported License.

Indexed in Scopus

Full-text version of the journal is also available on the web site of the scientific electronic library eLIBRARY.RU

The journal is included in the Russian Science Citation Index

The journal is included in the RSCI

International Interdisciplinary Conference "Mathematics. Computing. Education"

Copyright © 2009–2024 Institute of Computer Science