数字农科院2.0

Field-scale yield prediction of winter wheat under different irrigation regimes based on dynamic fusion of multimodal UAV imagery

文献类型： 外文期刊

作者： Juncheng Ma;Binhui Liu;Lin Ji;Zhicheng Zhu;Yongfeng Wu;Weihua Jiao

作者机构：

关键词： Deep learning;Dynamic fusion;Multimodal UAV imagery;Winter wheat;Yield prediction

期刊名称： International Journal of Applied Earth Observation and Geoinformation

ISSN： 1569-8432

年卷期： 2023 年 118 卷

页码：

收录情况： SCIE（2023版）

摘要： Field-scale crop yield prediction is critical to site-specific field management, which has been facilitated by recent studies fusing unmanned aerial vehicles (UAVs) based multimodal data. However, these studies equivalently stacked multimodal data and underused canopy spatial information. In this study, multimodal imagery fusion (MIF) attention was proposed to dynamically fuse UAV-based RGB, hyperspectral near-infrared (HNIR), and thermal imagery. Based on the MIF attention, a novel model termed MultimodalNet was proposed for field-scale yield prediction of winter wheat. To compare multimodal imagery-based and multimodal features-based methods, a stacking-based ensemble learning model was built using UAV-based canopy spectral, thermal, and texture features. The results showed that the MultimodalNet achieved accurate results at the reproductive stage and performed better than any single modality in the fusion. The MultimodalNet performed best at the flowering stage, with a coefficient of determination of 0.7411 and a mean absolute percentage error of 6.05%. The HNIR and thermal imagery were essential in yield prediction of winter wheat at the reproductive stage. Compared to equivalent stacking fusion, dynamic fusion through adaptively adjusting modality attention improved the model accuracy and adaptability across winter wheat cultivars and water treatments. Equivalently stacking more modalities did not necessarily yield improved performance than dynamically fusing fewer modalities. Methods using multimodal UAV imagery with rich spatial information were more applicable than methods using multimodal features to field-scale yield prediction. This study indicates that the MultimodalNet makes a powerful tool for field-scale yield prediction of winter wheat.

分类号：

  • 相关文献

[1]REGIONAL YIELD PREDICTION OF WINTER WHEAT BASED ON RETRIEVAL OF LEAF AREA INDEX BY REMOTE SENSING TECHNOLOGY. Ren, Jianqiang,Chen, Zhongxin,Zhou, Qingbo,Ren, Jianqiang,Chen, Zhongxin,Zhou, Qingbo,Yang, Xiaomei,Liu, Xingren. 2009

[2]Yield estimation of winter wheat in North China Plain by using crop growth monitoring system (CGMS). Teng Fei,Chen Zhongxin,Wu Wenbin,Huang Qing,Li Dandan,Xia Tian. 2012

[3]Integrating satellite-derived climatic and vegetation indices to predict smallholder maize yield using deep learning. Liangliang Zhang,Zhao Zhang,Yuchuan Luo,Juan Cao,Ruizhi Xie,Shaokun Li. 2021

[4]Deep learning-based association analysis of root image data and cucumber yield. Zhu, Cuifang,Yu, Hongjun,Lu, Tao,Li, Yang,Jiang, Weijie,Li, Qiang. 2024

[5]Long-Term Inorganic Plus Organic Fertilization I.ncreases Yield And Yield S tability Of Winter Wheat. Chen, H, Deng, AX, Zhang, WJ, Li, W, Qi, YQ, Yang, TM, Zheng, CY, Cao, CF, Chen, F. 2018

[6]CHINA CROP GROWTH MONITORING SYSTEM-METHODOLOGY AND OPERATIONAL ACTIVITIES OVERVIEW. Huang Qing,Chen Zhongxin,Wu Wenbin,Teng Fei,Li Dandan,de Wit, Allard. 2011

[7]Methodological evolution of potato yield prediction: a comprehensive review. Yongxin Lin,Shuang Li,Shaoguang Duan,Yanran Ye,Bo Li,Guangcun Li,Dianqiu Lyv,Liping Jin,Chunsong Bian,Jiangang Liu. 2023

[8]Combining multi-indicators with machine-learning algorithms for maize yield early prediction at the county-level in China. Minghan Cheng,Josep Penuelas,Matthew F. McCabe,Clement Atzberger,Xiyun Jiao,Wenbin Wu,Xiuliang Jin. 2022

[9]Strategies for monitoring within-field soybean yield using Sentinel-2 Vis-NIR-SWIR spectral bands and machine learning regression methods. Crusiol, L. G. T.,Sun, Liang,Sibaldelli, R. N. R.,Felipe Junior, V,Furlaneti, W. X.,Chen, R.,Sun, Z.,Wuyun, D.,Chen, Z.,Nanni, M. R.,Furlanetto, R. H.,Cezar, E.,Nepomuceno, A. L.,Farias, J. R. B.. 2022

[10]Exploring the potential role of environmental and multi-source satellite data in crop yield prediction across Northeast China. Zhenwang Li,Lei Ding,Dawei Xu. 2022

[11]Combining multi-indicators with machine-learning algorithms for maize at the-level in China. Cheng, Minghan,Penuelas, Josep,McCabe, Matthew F.,Atzberger, Clement,Jiao, Xiyun,Wu, Wenbin,Jin, Xiuliang. 2022

[12]Predicting maize yield in Northeast China by a hybrid approach combining biophysical modelling and machine learning. Jianzheng Li,Ganqiong Li,Ligang Wang,Denghua Li,Hu Li,Chao Gao,Minghao Zhuang,Jiayu Zhuang,Han Zhou,Shiwei Xu,Zhengjiang Hu,Enli Wang. 2023

[13]Wheat Yield Prediction Using Machine Learning Method Based on UAV Remote Sensing Data. Shurong Yang,Lei Li,Shuaipeng Fei,Mengjiao Yang,Zhiqiang Tao,Yaxiong Meng,Yonggui Xiao. 2024

[14]Multi-random ensemble on Partial Least Squares regression to predict wheat yield and its losses across water and nitrogen stress with hyperspectral remote sensing. Bohan Mao,Qian Cheng,Li Chen,Fuyi Duan,Xiaoxiao Sun,Yafeng Li,Zongpeng Li,Weiguang Zhai,Fan Ding,Hao Li,Zhen Chen. 2024

[15]Dual sampling linear regression ensemble to predict wheat yield across growing seasons with hyperspectral sensing. Fei S.,Xiao S.,Zhu J.,Xiao Y.,Ma Y.. 2024

[16]Peanut yield prediction using remote sensing and machine learning approaches based on phenological characteristics. Xuehui Hou,Junyong Zhang,Xiubin Luo,Shiwei Zeng,Yan Lu,Qinggang Wei,Jia Liu,Wenjie Feng,Qiaoyu Li. 2025

[17]Machine Learning-Driven Construction of High-Yielding Cucumber Plant Architectures in Greenhouse Environments. Zhu, Cuifang,Yu, Hongjun,Zhao, Caili,Wu, Hongyang,Wan, Xiaoyang,Lu, Tao,Li, Yang,Jiang, Weijie,Li, Qiang. 2026

[18]Application Of Energy And Water B.alance Methods: A Comparative S tudy On Wheat Evapotranspiration Rates. Zhang, Jiyang,Duan, Aiwang,Liu, Xiaofei,Meng, Zhaojiang,Meng, Zhaojiang,Zhang, Jiyang,Liu, Zugui,Zhang, Yingying,Zhang, Yingying,Duan, Aiwang,Fei, Liangjun,Liu, Xiaofei,Liu, Zugui. 2017

[19]Estimating Above Ground Biomass Of W.inter Wheat At Early G rowth Stages Based On Visual Spectral. Sun Zhong:fu,Li Yun:xia,Ma Jun:cheng,Du Ke:ming,Zhang Ling:xian,Zheng Fei:xiang,Chen Yun:qiang. 2019

[20]Long-Term Inorganic Plus Organic Fertilization I.ncreases Yield And Yield S tability Of Winter Wheat. Cao, Chengfu,Chen, Huan,Zhang, Weijian,Yang, Taiming,Zheng, Chengyan,Qi, Yuqiang,Deng, Aixing,Chen, Fu,Li, Wei,Chen, Huan,Chen, Huan. 2018

作者其他论文 更多>>