数字农科院2.0

Cross-domain transfer learning for weed segmentation and mapping in precision farming using ground and UAV images

文献类型： 外文期刊

作者： Junfeng Gao;Wenzhi Liao;David Nuyttens;Peter Lootens;Wenxin Xue;Erik Alexandersson;Jan Pieters

作者机构：

关键词： Cross-domain learning;Deep learning;Feature visualization;Remote sensing;Weed mapping;Weighted loss

期刊名称： Expert Systems with Applications

ISSN： 0957-4174

年卷期： 2024 年 246 卷

页码：

收录情况： SCIE（2024版） ; ; EI（2024版）

摘要： Weed and crop segmentation is becoming an increasingly integral part of precision farming that leverages the current computer vision and deep learning technologies. Research has been extensively carried out based on images captured with a camera from various platforms. Unmanned aerial vehicles (UAVs) and ground-based vehicles including agricultural robots are the two popular platforms for data collection in fields. They all contribute to site-specific weed management (SSWM) to maintain crop yield. Currently, the data from these two platforms is processed separately, though sharing the same semantic objects (weed and crop). In our paper, we have proposed a novel method with a new deep learning-based model and the enhanced data augmentation pipeline to train field images alone and subsequently predict both field images and UAV images for weed segmentation and mapping. The network learning process is visualized by feature maps at shallow and deep layers. The results show that the mean intersection of union (IOU) values of the segmentation for the crop (maize), weeds, and soil background in the developed model for the field dataset are 0.744, 0.577, 0.979, respectively, and the performance of aerial images from an UAV with the same model, the IOU values of the segmentation for the crop (maize), weeds and soil background are 0.596, 0.407, and 0.875, respectively. To estimate the effect on the use of plant protection agents, we quantify the relationship between herbicide spraying saving rate and grid size (spraying resolution) based on the predicted weed map. The spraying saving rate is up to 90 % when the spraying resolution is at 1.78 × 1.78 cm2. The study shows that the developed deep convolutional neural network could be used to classify weeds from both field and aerial images and delivers satisfactory results. To achieve this performance, it is crucial to perform preprocessing techniques that reduce dataset differences between two distinct domains.

分类号：

  • 相关文献

[1]Semantic Segmentation Based on Temporal Features: Learning of Temporal-Spatial Information From Time-Series SAR Images for Paddy Rice Mapping. Yang, Lingbo,Huang, Ran,Huang, Jingfeng,Lin, Tao,Wang, Limin,Mijiti, Ruzemaimaiti,Wei, Pengliang,Tang, Chao,Shao, Jie,Li, Qiangzi,Du, Xin. 2021

[2]Integrating satellite-derived climatic and vegetation indices to predict smallholder maize yield using deep learning. Liangliang Zhang,Zhao Zhang,Yuchuan Luo,Juan Cao,Ruizhi Xie,Shaokun Li. 2021

[3]Deep learning for change detection in remote sensing: a review. Bai, Ting,Wang, Le,Yin, Dameng,Sun, Kaimin,Chen, Yepei,Li, Wenzhuo,Li, Deren. 2022

[4]Real-Time Object Detection Based on UAV Remote Sensing: A Systematic Literature Review. Zhen Cao,Lammert Kooistra,Wensheng Wang,Leifeng Guo,João Valente. 2023

[5]Assessing and segmenting salt-affected soils using in-situ EC measurements, remote sensing, and a modified deep learning MU-NET convolutional neural network. Mustafa El-Rawy,Sally Y. Sayed,Mohamed A.E. AbdelRahman,Atef Makhloof,Nassir Al-Arifi,Mahmoud Khaled Abd-Ellah. 2024

[6]AECA-FBMamba: A Framework with Adaptive Environment Channel Alignment and Mamba Bridging Semantics and Details. Xin Chai,Wenrong Zhang,Zhaoxin Li,Ning Zhang,Xiujuan Chai. 2025

[7]Research on Contactless Detection of Sow Backfat Thickness Based on Segmented Images with Feature Visualization. Cao, Tingjin,Li, Xuan,Liu, Xiaolei,Liang, Hao,Wang, Haiyan,Xu, Dihong. 2024

[8]Transfer Learning in Junction With a Light Use Efficiency Model for Estimating Grassland Gross Primary Production. Yu, Ruiyang,Yao, Yunjun,Tang, Qingxin,Zhang, Xueyi,Shao, Changliang,Fisher, Joshua B.,Chen, Jiquan,Zhang, Xiaotong,Li, Yufu,Xu, Jia,Liu, Lu,Xie, Zijing,Ning, Jing,Fan, Jiahui,Zhang, Luna. 2025

[9]DEVELOPING A DESERTIFICATION ASSESSMENT SYSTEM USING A PHOTOSYNTHESIS MODEL WITH ASIMILLATED MULTI SATELLITE DATA. Kaneko, D.,Yang, P.,Kumakura, T.,Yang, P.,Chang, N. B.. 2010

[10]The Effect of Vegetation on the Remotely Sensed Soil Thermal Inertia and a Two-Source Normalized Soil Thermal Inertia Model for Vegetated Surfaces. Zhang, Renhua,Tian, Jing,Mi, Sujuan,Su, Hongbo,Liu, Kai,Mi, Sujuan,Liu, Kai,Su, Hongbo,He, Honglin,Li, Zhaoliang. 2016

[11]Detection of rice sheath blight for in-season disease management using multispectral remote sensing. Qin, ZH,Zhang, MH. 2005

[12]Spatial dynamics modelling of crops pattern with remote sensing classification data. Xia, Tian,Wu, Wenbin,Zhou, Qingbo,Yang, Peng,Liu, Yanxia. 2014

[13]Estimation of Atmospheric Profiles From Hyperspectral Infrared IASI Sensor. Wu, Hua,Tang, Bo-Hui,Ni, Li,Wang, Ning,Qian, Yonggang,Li, Zhao-Liang,Li, Zhao-Liang. 2013

[14]Monitoring the Plant Density of Cotton with Remotely Sensed Data. Bai, Junhua,Li, Shaokun,Bai, Junhua,Li, Jing,Bai, Junhua. 2011

[15]Assimilating MODIS-LAI into Crop Growth Model with EnKF to Predict Regional Crop Yield. Huang, Jianxi,Ma, Guannan,Wu, Sijie,Liu, Xingquan,Fan, Jinlong,Zou, Jinqiu. 2012

[16]Remote sensing monitoring of grass growing in grassland ecosystems of China. Qin, Zhihao,Xu, Bin,Tao, Weiguo. 2007

[17]Remote sensing of agro-droughts in Guangdong province of China using MODIS satellite data. Gao, Maofang,Qin, Zhihao,Yang, Xiuchun,Qin, Zhihao,Zhang, Hong'ou,Zhou, Xia,Qin, Zhihao,Lu, Liping. 2008

[18]Jointly Assimilating MODIS LAI and ET Products Into the SWAP Model for Winter Wheat Yield Estimation. Huang, Jianxi,Ma, Hongyuan,Su, Wei,Zhang, Xiaodong,Huang, Jianxi,Ma, Hongyuan,Su, Wei,Zhang, Xiaodong,Huang, Yanbo,Fan, Jinlong,Wu, Wenbin. 2015

[19]Progress in soil moisture estimation from remote sensing data for agricultural drought monitoring. Yan, Feng,Qin, Zhihao,Yan, Feng,Qin, Zhihao,Li, Maosong,Li, Wenjuan. 2006

[20]Monitoring land use dynamics for ecological degradation assessment in the rim zone of North China using MODIS and Land TM data. Qin, ZH,Xu, B,Liu, J,Li, WJ,Zhang, WC,Zhang, HO. 2004

作者其他论文 更多>>