数字农科院2.0

A counting method of whiteflies on crop leave images captured by AR glasses based on segmentation and improved YOLOv11 models

文献类型： 外文期刊

作者： Shilong Zhao;Jun Lyu;Shuhua Liu;Zelin Feng;Heping Ling;Jiabao Jiao;Zhaoxin Ni;Baojun Yang;Qing Yao;Ju Luo

作者机构：

关键词： AR glasses;automatic counting;image segmentation;object detection;whitefly

期刊名称： Frontiers in Plant Science

ISSN： 1664-462X

年卷期： 2025 年 16 卷

页码：

收录情况： SCIE（2025版）

摘要： The whitefly (Bemisia tabaci) is a globally distributed agricultural pest. While accurate monitoring of this species is crucial for early warning systems and efficient pest control, traditional manual monitoring methods suffer from subjectivity, low accuracy with large populations, and arduous data traceability. To surmount these challenges, this paper proposes an automatic counting method for whitefly adults and late-instar nymphs, based on whitefly images acquired using augmented reality (AR) glasses and a segmentation-then-detection approach. Acquired by the surveyors wearing AR glasses, the images of whiteflies on the undersides of crop leaves are transmitted to a server via Wi-Fi/5G. The system enables the automatic whitefly counting model to enumerate the adult and late-instar nymph populations, and the results can be viewed on both the AR glasses and mobile devices. The study utilizes Mask2Former-Leaf to segment the foreground primary leaf in pursuit of the minimal influence of non-primary leaf areas and background noise in the images, and detects tiny whitefly adults and late-instar nymphs in high-resolution images by involving the YOLOv11-Whitefly detection model. This model integrates Slicing Aided Hyper Inference (SAHI) capability, and can enormously amplify the feature representation of tiny objects by slicing large images through overlapping windows for both training and inference. Furthermore, DyCM-C3K2 is introduced into the YOLOv11 backbone network, which enhances the detection capability for small whitefly targets by dynamically generating input-dependent convolutional kernels, and injecting global contextual information into local convolution operations. Also, a Multi-Branch Channel Re-Weighted Feature Pyramid Network (MCRFPN) is designed to replace the original neck network, optimizing the fusion between superficial and deep features. In contrast to mainstream detection models such as YOLO, RTMDet, Cascade-CNN, DETR, and DINO, YOLOv11-Whitefly demonstrates superior performance—attaining an average recall rate of 86.20%, an average precision of 84.25%, and an mAP50 of 91.60% for whitefly adults and late-instar nymphs. With the purpose of visualizing the whitefly infestation data, this paper developed an intelligent whitefly survey system that provides on-site visualization of whitefly images integrated with their adult and late-instar nymph counting results. This facilitates surveyors in understanding pest populations and formulating scientific control decisions.

分类号：

  • 相关文献

[1]Automatic detection and counting of planthoppers on white flat plate images captured by AR glasses for planthopper field survey. Haiyuan Sheng,Qing Yao,Ju Luo,Yongjian Liu,Xiangfu Chen,Zhongru Ye,Tiezhuang Zhao,Heping Ling,Jian Tang,Shuhua Liu. 2024

[2]Intelligent survey method of rice diseases and pests using AR glasses and image-text multimodal fusion model. Xiangfu Chen,Baojun Yang,Yongjian Liu,Zelin Feng,Jun Lyu,Ju Luo,Jian Wu,Qing Yao,Shuhua Liu. 2025

[3]Host suitability of different instars of Bemisia tabaci biotype B for the parasitoid Eretmocerus hayati. Wan, Fang-Hao. 2011

[4]Host instar suitability in two invasive whiteflies for the naturally occurring parasitoid Eretmocerus hayati in China. Yang, Nian-Wan,Wan, Fang-Hao,Zhang, Yi-Bo,Sun, Li-Ying.

[5]BIOTYPE EXPRESSION AND INSECTICIDE RESPONSE OF Bemisia tabaci CHEMOSENSORY PROTEIN-1. Liu, Guo Xia,Xuan, Ning,Chu, Dong,Xie, Hong Yan,Fan, Zhong Xue,Bi, Yu Ping,Picimbon, Jean-Francois,Qin, Yu Chuan,Zhong, Su Ting,Li, Yao Fa,Gao, Zhan Lin,Pan, Wen Liang,Wang, Guo Ying,Rajashekar, Balaji.

[6]Density and Seasonal Dynamics of Bemisia tabaci (Gennadius) Mediterranean on Common Crops and Weeds Around Cotton Fields in Northern China. Yang Nian-wan,Wan Fang-hao,Lovei, Gabor L.,Lovei, Gabor L.. 2014

[7]A Whitefly Effector Bsp9 Targets H.ost Immunity Regulator Wrky33 T o Promote Performance. Wang, N, Zhao, PZ, Ma, YH, Yao, XM, Sun, YW, Huang, XD, Jin, JJ, Zhang, YJ, Zhu, CX, Fang, RX, Ye, J. 2019

[8]Molecular characteristics of three cold resistance genes and their roles in temperature stress response in two Bemisia tabaci cryptic species. Xiao-Na Shen, Shun-Xia Ji, Wan-Xue Liu, Jian-Ying Guo, Zhi-Chuan Lu, Fang-Hao Wan. 2021

[9]Catalase promotes whitefly adaptation to high temperature by eliminating reactive oxygen species. Liang, Peng,Ning, Jie,Wang, Wenlu,Zhu, Pu,Gui, Lianyou,Xie, Wen,Zhang, Youjun. 2023

[10]Prey Preference, Reproductive Performance, And L.ife Table Of Amblyseius T sugawai (Acari: Phytoseiidae) Feeding On Tetranychus Urticae And Bemisia Tabaci. Xu, Xunong,Wang, Endong,Liu, Jingyue,Yang, Jingyi,Lv, Jiale. 2019

[11]Transcriptome data reveal beneficial effects of Rickettsia (Rickettsiales: Rickettsiaceae) on Bemisia tabaci (Hemiptera: Aleyrodidae) through nutritional factors and defense mechanisms. Li, Yi-Han,Peng, Jing,Wu, Qing-Jun,Sun, Jing-Chen,Zhang, Peng-Jun,Qiu, Bao-Li. 2024

[12]Sensitivity monitoring of Bemisia tabaci to two tetramic acid insecticides and baseline susceptibility to spiropidion in China. Liu, Xiaolan,Hu, Xichao,Wen, Zanrong,Tang, Haoyu,Ma, Jianyu,Qiu, Bo,Xu, Wei,Chi, Xiuli,Lv, Chao,Guo, Lei,Zhang, Yongjun. 2025

[13]Impact of transinfection of Wolbachia from the planthopper Laodelphax striatellus on reproductive fitness and transcriptome of the whitefly Bemisia tabaci. Hongyan Hu,Zhenhua Lu,Yajie Ma,Xianpeng Song,Dan Wang,Changcai Wu,Xiaoyan Ma,Yongpan Shan,Xiangliang Ren,Yan Ma. 2024

[14]Sublethal effects of thiamethoxam on Encarsia formosa: intergenerational impacts and insights from transcriptomic analysis. Wang, Ke,He, Yanyan,Zhang, Yan,Dong, Rui,Hu, Shouyin,Yang, Zezhong,Guo, Zhaojiang,Zhang, Youjun,Xie, Wen,Wang, Shaoli. 2025

[15]Robust Image Segmentation Method For C.otton Leaf Under Natural C onditions Based On Immune Algorithm And Pcnn Algorithm. Kong, Fantao,Zhai, Zhifen,Wu, Jianzhai,Zhang, Jianhua,Han, Shuqing. 2018

[16]Image Segmentation to HSI Model Based on Improved Particle Swarm Optimization. Zhao, Bo,Mao, Wenhua,Zhang, Xiaochao,Chen, Yajun. 2009

[17]A segmentation method for greenhouse vegetable foliar disease spots images using color information and region growing. Ma, Juncheng,Du, Keming,Zheng, Feixiang,Chu, Jinxiang,Sun, Zhongfu,Zhang, Lingxian.

[18]Image segmentation of G bands of Triticum monococcum chromosomes based on the model-based neural network. Cai, N,Hu, KH,Xiong, HT,Li, SY,Su, WF,Zhu, FS.

[19]Marbling-Net: A Novel Intelligent Framework for Pork Marbling Segmentation Using Images from Smartphones. Shufeng Zhang,Yuxi Chen,Weizhen Liu,Bang Liu,Xiang Zhou. 2023

[20]Detection method of rice blast based on 4D light field refocusing depth information fusion. Yang N.,Chang K.,Tang J.,Xu L.,He Y.,Huang R.,Yu J.. 2023

作者其他论文 更多>>