数字农科院2.0

GRPoseNet: a generalizable and robust 6D object pose estimation network using sparse RGB views

文献类型： 外文期刊

作者： Shi, Wubin;Gai, Shaoyan;Da, Feipeng;Cai, Zeyu;Wang, Jiaoling

作者机构：

关键词： Object pose estimation;Deep learning;Generalizable;Zero shot

期刊名称： VISUAL COMPUTER

ISSN： 0178-2789

年卷期： 2025 年

页码：

收录情况： SCIE（2025版） ; ; EI（2025版）

摘要： Six-degree-of-freedom object pose estimation plays a crucial role in various computer vision and robotics tasks. Existing methods often rely heavily on CAD models and substantial prior information, limiting their generalization to unseen objects in open scenes. To address this limitation, we propose GRPoseNet, a generalizable and robust 6D object pose estimation network that can predict the pose of unseen objects using only sparse RGB images with reference poses. GRPoseNet comprises an open-world detector, a viewpoint selector, and an adaptive multi-scale refiner. The open-world detector leverages pre-trained large models for zero-shot segmentation and feature extraction, overcoming detection and matching errors with unseen objects. The viewpoint selector uses our designed similarity network to select the most similar reference view for initial pose estimation. The adaptive multi-scale refiner further refines the pose by iteratively updating rotation and translation residuals based on multi-scale features and adaptive weights. Extensive experiments on benchmark datasets and our robust test dataset, RBMOP, demonstrate that GRPoseNet achieves state-of-the-art performance, showing excellent generalization and robustness to unseen objects and sparse views. The codes and datasets are available at: https://github.com/KierSaS/GRPoseNet.

分类号：

  • 相关文献

[1]Deep learning based weed detection and target spraying robot system at seedling stage of cotton field. Xiangpeng Fan,Xiujuan Chai,Jianping Zhou,Tan Sun. 2023

[2]Inter-Continental Transfer of Pre-Trained Deep Learning Rice Mapping Model and Its Generalization Ability. Lingbo Yang,Ran Huang,Jingcheng Zhang,Jingfeng Huang,Limin Wang,Jiancong Dong,Jie Shao. 2023

[3]Semantic Segmentation Based on Temporal Features: Learning of Temporal-Spatial Information From Time-Series SAR Images for Paddy Rice Mapping. Yang, Lingbo,Huang, Ran,Huang, Jingfeng,Lin, Tao,Wang, Limin,Mijiti, Ruzemaimaiti,Wei, Pengliang,Tang, Chao,Shao, Jie,Li, Qiangzi,Du, Xin. 2021

[4]A Novel Physics-Statistical Coupled Paradigm for Retrieving Integrated Water Vapor Content Based on Artificial Intelligence. Ruyu Mei,Kebiao Mao,Jiancheng Shi,Jeffrey Nielson,Sayed M. Bateni,Fei Meng,Guoming Du. 2023

[5]Machine learning for image-based multi-omics analysis of leaf veins. Yubin Zhang,Ning Zhang,Xiujuan Chai,Tan Sun. 2023

[6]Auction-based deep learning-driven smart agricultural supply chain mechanism. Yu Feng,Dong Mei,Hua Zhao. 2023

[7]Research on machine vision and deep learning based recognition of cotton seedling aphid infestation level. Xin Xu,Jing Shi,Yongqin Chen,Qiang He,Liangliang Liu,Tong Sun,Ruifeng Ding,Yanhui Lu,Chaoqun Xue,Hongbo Qiao. 2023

[8]Integrating satellite-derived climatic and vegetation indices to predict smallholder maize yield using deep learning. Liangliang Zhang,Zhao Zhang,Yuchuan Luo,Juan Cao,Ruizhi Xie,Shaokun Li. 2021

[9]A rapid, low-cost deep learning system to classify strawberry disease based on cloud service. Guo feng YANG,Yong YANG,Zi kang HE,Xin yu ZHANG,Yong HE. 2022

[10]Deep learning for change detection in remote sensing: a review. Bai, Ting,Wang, Le,Yin, Dameng,Sun, Kaimin,Chen, Yepei,Li, Wenzhuo,Li, Deren. 2022

[11]Mapping of lakes in the Qinghai-Tibet Plateau from 2016 to 2021: trend and potential regularity. Zhichong Yang,Si Bo Duan,Xiaoai Dai,Yingwei Sun,Meng Liu. 2022

[12]Bionic technology and deep learning in agricultural engineering: Current status and future prospects. Chunlei Tu,Jinxia Li,Xingsong Wang,Shen Cheng,Jie Li. 2021

[13]Automatic freezing-tolerant rapeseed material recognition using UAV images and deep learning. Lili Li,Jiangwei Qiao,Jian Yao,Jie Li,Li Li. 2022

[14]Evaluation of deep learning for automatic multi‐view face detection in cattle. Beibei Xu,Wensheng Wang,Leifeng Guo,Guipeng Chen,Yaowu Wang,Wenju Zhang,Yongfeng Li. 2021

[15]Semi-Supervised Transformation and Deep Embedding-Based Anomaly Identification for Agricultural Internet of Things. Xiang Yin,Letian Wang,Weikuan Jia,Chengqian Jin. 2021

[16]Identification method of wheat cultivars by using a convolutional neural network combined with images of multiple growth periods of wheat. Jiameng Gao,Chengzhong Liu,Junying Han,Qinglin Lu,Hengxing Wang,Jianhua Zhang,Xuguang Bai,Jiake Luo. 2021

[17]A synthetic datasets based instance segmentation network for High-throughput soybean pods phenotype investigation. Yang, Si,Zheng, Lihua,Yang, Huijun,Zhang, Man,Wu, Tingting,Sun, Shi,Tomasetto, Federico,Wang, Minjuan. 2022

[18]A method for land surface temperature retrieval based on model-data-knowledge-driven and deep learning. Han Wang,Kebiao Mao,Zijin Yuan,Jiancheng Shi,Mengmeng Cao,Zhihao Qin,Sibo Duan,Bohui Tang. 2021

[19]Predicting equivalent water thickness in wheat using UAV mounted multispectral sensor through deep learning techniques. Adama Traore,Syed Tahir Ata-Ul-karim,Aiwang Duan,Mukesh Kumar Soothar,Seydou Traore,Ben Zhao. 2021

[20]Culling Double Counting in Sequence Images for Fruit Yield Estimation. Xue Xia,Xiujuan Chai,Ning Zhang,Zhao Zhang,Qixin Sun,Tan Sun. 2022

作者其他论文 更多>>