数字农科院2.0

Soybean Lodging Classification and Yield Prediction Using Multimodal UAV Data Fusion and Deep Learning

文献类型： 外文期刊

作者： Xingmei Xu;Yushi Fang;Guangyao Sun;Yong Zhang;Lei Wang;Chen Chen;Lisuo Ren;Lei Meng;Yinghui Li;Lijuan Qiu;Yan Guo;Helong Yu;Yuntao Ma

作者机构：

关键词： data fusion;deep learning;lodging classification;UAV;yield

期刊名称： Remote Sensing

ISSN： 2072-4292

年卷期： 2025 年 17 卷 9 期

页码：

收录情况： SCIE（2025版） ; ; EI（2025版）

摘要： UAV remote sensing is widely used in the agricultural sector due to its non-destructive, rapid, and cost-effective advantages. This study utilized two years of field data with multisource fused imagery of soybeans to evaluate lodging conditions and investigate the impact of lodging grade information on yield prediction. Unlike traditional approaches that build empirical lodging models using band reflectance, vegetation indices, and texture features, this research introduces a transfer learning framework. This framework employs a ResNet18 encoder to directly extract features from raw images, bypassing the complexity of manual feature extraction processes. To address the imbalance in the lodging dataset, the Synthetic Minority Over-sampling Technique (SMOTE) strategy was employed in the feature space to balance the training set. The findings reveal that deep learning effectively extracts meaningful features from UAV imagery, outperforming traditional methods in lodging grade classification across all growth stages. On the 65 days after emergence (DAE), lodging grade classification using ResNet18 features achieved the highest accuracy (Accuracy = 0.76, recall = 0.76, F1 score = 0.73), significantly exceeding the performance of traditional methods. However, classification accuracy was relatively low in plots with higher lodging grades (lodging grades = 3, 5, 7), with an accuracy of 0.42 and an F1 score of 0.56. After applying the SMOTE module to balance the samples, the classification accuracy in plots with higher lodging grades improved to 0.65, marking an increase of 54.76%. To improve accuracy in yield prediction, this study integrates lodging information with other features, such as canopy spectral reflectance, vegetation indices, and texture features, using two multimodal data fusion strategies: input-level fusion (ResNet-EF) and intermediate-level fusion (ResNet-MF). The findings reveal that the intermediate-level fusion strategy consistently outperforms input-level fusion in yield prediction accuracy across all growth stages. Specifically, the intermediate-level fusion model incorporating measured lodging grade information achieved the highest prediction accuracy on the 85 DAE (R2 = 0.65, RMSE = 529.56 kg/ha). Furthermore, when predicted lodging information was used, the model’s performance remained comparable to that of the measured lodging grades, underscoring the critical role of lodging factors in enhancing yield estimation accuracy.

分类号：

  • 相关文献

[1]UAV-based LiDAR and multispectral sensors fusion for cotton yield estimation: Plant height and leaf chlorophyll content as a bridge linking remote sensing data to yield. Bin Wu,Liqiang Fan,Bowei Xu,Jiajie Yang,Rumeng Zhao,Qiong Wang,Xiantao Ai,Huixin Zhao,Zuoren Yang. 2025

[2]UAV-Based Multimodal Monitoring of Tea Anthracnose with Temporal Standardization. Yu, Qimeng,Zhang, Jingcheng,Yuan, Lin,Li, Xin,Zeng, Fanguo,Xu, Ke,Huang, Wenjiang,Shen, Zhongting. 2025

[3]Surface Soil Moisture Retrieval over Winter Wheat Fields Based on Fused Multispectral and L-Band MiniSAR Data. Ziyi Luo,Xianyu Zhang,Yonghui Wang,Chengcai Zhang,Mingliang Jiang,Xingxing Zhu. 2025

[4]Predicting equivalent water thickness in wheat using UAV mounted multispectral sensor through deep learning techniques. Adama Traore,Syed Tahir Ata-Ul-karim,Aiwang Duan,Mukesh Kumar Soothar,Seydou Traore,Ben Zhao. 2021

[5]Detection and Counting of Maize Leaves Based on Two-Stage Deep Learning with UAV-Based RGB Image. Xu, Xingmei,Wang, Lu,Shu, Meiyan,Liang, Xuewen,Ghafoor, Abu Zar,Liu, Yunling,Ma, Yuntao,Zhu, Jinyu. 2022

[6]Real-Time Object Detection Based on UAV Remote Sensing: A Systematic Literature Review. Zhen Cao,Lammert Kooistra,Wensheng Wang,Leifeng Guo,João Valente. 2023

[7]GLDCNet: A novel convolutional neural network for grapevine leafroll disease recognition using UAV-based imagery. Yixue Liu,Jinya Su,Zhouzhou Zheng,Dizhu Liu,Yuyang Song,Yulin Fang,Peng Yang,Baofeng Su. 2024

[8]Precise extraction of targeted apple tree canopy with YOLO-Fi model for advanced UAV spraying plans. Peng Wei,Xiaojing Yan,Wentao Yan,Lina Sun,Jun Xu,Huizhu Yuan. 2024

[9]Maize tassel number and tasseling stage monitoring based on near-ground and UAV RGB images by improved YoloV8. Yu, Xun,Yin, Dameng,Xu, Honggen,Espinosa, Francisco Pinto,Schmidhalter, Urs,Nie, Chenwei,Bai, Yi,Sankaran, Sindhuja,Ming, Bo,Cui, Ningbo,Wu, Wenbin,Jin, Xiuliang. 2024

[10]Xoo-YOLO: a detection method for wild rice bacterial blight in the field from the perspective of unmanned aerial vehicles. Pan Pan,Wenlong Guo,Xiaoming Zheng,Lin Hu,Guomin Zhou,Jianhua Zhang. 2023

[11]Maize tassel area dynamic monitoring based on near-ground and UAV RGB images by U-Net model. Xun Yu,Dameng Yin,Chenwei Nie,Bo Ming,Honggen Xu,Yuan Liu,Yi Bai,Mingchao Shao,Minghan Cheng,Yadong Liu,Shuaibing Liu,Zixu Wang,Siyu Wang,Lei Shi,Xiuliang Jin. 2022

[12]Early detection of Citrus Huanglongbing by UAV remote sensing based on MGA-UNet. Naibo Ye,Wenyong Mai,Feng Qin,Sen Yuan,Bo Liu,Zaiyuan Li,Conghui Liu,Fanghao Wan,Wanqiang Qian,Zhongzhen Wu,Xi Qiao. 2025

[13]Screening Verticillium wilt-resistant germplasm by monitoring the time-series chlorophyll content of cotton canopies via a UAV-based high-throughput platform. Bowei Xu,Jiajie Yang,Deyong Chen,Xuwen Wang,Xiantao Ai,Le Liu,Rumeng Zhao,Jieyin Chen,Xiaomei Ma,Fuguang Li,Zuoren Yang,Liqiang Fan. 2025

[14]Establishment of a high-throughput field defoliation data survey strategy combined with genome-wide association studies to reveal the genetic basis of defoliation in cotton. Bowei Xu,Le Liu,Rumeng Zhao,Jiajie Yang,Bin Wu,Lili Lu,Xiantao Ai,Jingshan Tian,Fuguang Li,Kai Zheng,Liqiang Fan,Zuoren Yang. 2025

[15]Mapping grapevine leafroll disease epidemics from UAV images. Yixue Liu,Jinya Su,Dizhu Liu,Yuyang Song,Yulin Fang,Baofeng Su,Peng Yang. 2025

[16]Estimation of soybean yield parameters under lodging conditions using RGB information from unmanned aerial vehicles. Bai D.,Li D.,Zhao C.,Wang Z.,Shao M.,Guo B.,Liu Y.,Wang Q.,Li J.,Guo S.,Wang R.,Li Y.-H.,Qiu L.-J.,Jin X.. 2023

[17]Monitoring and Optimization of Potato Growth Dynamics under Different Nitrogen Forms and Rates Using UAV RGB Imagery. Yanran Ye,Liping Jin,Chunsong Bian,Jiangang Liu,Huachun Guo. 2024

[18]Mapping global cropland and field size. Fritz, Steffen,See, Linda,McCallum, Ian,Bun, Andriy,Moltchanova, Elena,Duerauer, Martina,Perger, Christoph,Havlik, Petr,Mosnier, Aline,Schepaschenko, Dmitry,van der Velde, Marijn,Dunwoody, Antonia,Kraxner, Florian,Obersteiner, Michael,You, Liangzhi,You, Liangzhi,Wood-Sichra, Ulrike,Moltchanova, Elena,Albrecht, Fransizka,Albrecht, Fransizka,Schill, Christian,Thornton, Philip,Herrero, Mario,Becker-Reshef, Inbal,Justice, Chris,Hansen, Matthew,Gong, Peng,Aziz, Sheta Abdel,Cipriani, Anna,Cipriani, Anna,Malanding, Jaiteh,Cumani, Renato,Conchedda, Giulia,Cecchi, Giuliano,Ferreira, Stefanus,Gomez, Adriana,Haffani, Myriam,Kayitakire, Francois,Vancutsem, Christelle,Mueller, Rick,Newby, Terence,Nonguierma, Andre,Olusegun, Adeaga,Ortner, Simone,Rajak, D. Ram,Rocha, Jansle,Schepaschenko, Maria,Terekhov, Alexey,Tiangwa, Alex,Vintrou, Elodie,Wu Wenbin.

[19]An Enhanced Spatial and Temporal Data Fusion Model for Fusing Landsat and MODIS Surface Reflectance to Generate High Temporal Landsat-Like Data. Zhang, Wei,Qin, Zhihao,Zhang, Wei,Li, Ainong,Jin, Huaan,Bian, Jinhu,Zhang, Zhengjian,Lei, Guangbin,Huang, Chengquan. 2013

[20]Research on moisture content detection method during green tea processing based on machine vision and near-infrared spectroscopy technology. Zhongyuan Liu,Rentian Zhang,Chongshan Yang,Bin Hu,Xin Luo,Yang Li,Chunwang Dong. 2022

作者其他论文 更多>>