高级检索

基于多模态融合的机械臂抓取检测方法研究

Research on Robotic Arm Grasp Detection Method Based on Multimodal Fusion

  • 摘要: 为了提升机械臂抓取的成功率,提出了一种基于多模态融合的机械臂抓取检测神经网络。首先,对基于神经网络的抓取检测任务进行介绍。接着,提出了一种多模态全阶段全分支融合抓取检测网络。然后,在Cornell数据集和Jacquard数据集上进行抓取检测实验,证明所提出的MESB-GDN相比与其他SOTA方法的预测性能更优异。最后,在机械臂上进行实物抓取实验,证明相比其他SOTA方法,MESB-GDN机械臂的抓取成功率最高。

     

    Abstract: In order to improve the grasping success rate, this paper proposes a robot grasping detection neural network based on multimodal fusion. The main contents are as follows: First, the grasping detection task based on neural network is introduced. Then, a MESB-GDN is proposed. Then, by conducting grasping detection experiments on Cornell dataset and Jacquard dataset, it is proved that the proposed MESB-GDN has better prediction performance than other SOTA methods. Finally, a physical grasping experiment is carried out on the robot, which proves that the robot using MESB-GDN has the highest autonomous grasping success rate compared with other SOTA methods.

     

/

返回文章
返回