Robot grabbing method and system based on multi-modal feature extraction and dense prediction
The invention discloses a robot grabbing method and system based on multi-modal feature extraction and dense prediction, and the method comprises the steps: obtaining a scene color image and a depth image, calculating a scene three-dimensional point cloud and adaptive convolution receptive fields of...
Saved in:
Main Authors | , , , , , , , , , |
---|---|
Format | Patent |
Language | Chinese English |
Published |
06.01.2023
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Abstract | The invention discloses a robot grabbing method and system based on multi-modal feature extraction and dense prediction, and the method comprises the steps: obtaining a scene color image and a depth image, calculating a scene three-dimensional point cloud and adaptive convolution receptive fields of different scales from the depth image, and obtaining a surface normal vector image according to the scene three-dimensional point cloud; a multi-modal feature extraction and dense prediction network is constructed, a scene color image and a surface normal vector image are processed, dense three-dimensional attitude information and three-dimensional position information predicted by each type of objects are obtained, three-dimensional attitudes and three-dimensional positions of corresponding objects are obtained through calculation, and the three-dimensional attitudes and the three-dimensional positions jointly form three-dimensional poses. And the three-dimensional pose is sent to a robot grabbing system, and the |
---|---|
AbstractList | The invention discloses a robot grabbing method and system based on multi-modal feature extraction and dense prediction, and the method comprises the steps: obtaining a scene color image and a depth image, calculating a scene three-dimensional point cloud and adaptive convolution receptive fields of different scales from the depth image, and obtaining a surface normal vector image according to the scene three-dimensional point cloud; a multi-modal feature extraction and dense prediction network is constructed, a scene color image and a surface normal vector image are processed, dense three-dimensional attitude information and three-dimensional position information predicted by each type of objects are obtained, three-dimensional attitudes and three-dimensional positions of corresponding objects are obtained through calculation, and the three-dimensional attitudes and the three-dimensional positions jointly form three-dimensional poses. And the three-dimensional pose is sent to a robot grabbing system, and the |
Author | LIU XUEBING FENG MINGTAO ZHU QING WU CHENGZHONG YUAN XIAOFANG HUANG JIANAN WANG YAONAN ZHOU XIAN'EN MAO JIANXU ZHOU JIAMING |
Author_xml | – fullname: LIU XUEBING – fullname: MAO JIANXU – fullname: FENG MINGTAO – fullname: ZHU QING – fullname: YUAN XIAOFANG – fullname: ZHOU XIAN'EN – fullname: WU CHENGZHONG – fullname: HUANG JIANAN – fullname: WANG YAONAN – fullname: ZHOU JIAMING |
BookMark | eNqNi0sKwjAURTPQgb89PBdQsGjVqRTFkQNxKvLS3NZAk5TkFXT3fnABji6cc-5YDXzwGKnrOegg1ETW2vqGHOQeDLE3lJ5J4EhzgqHgyfWt2MwFwy3VYOkjCA-JXIl968_FwCdQF2HsF07VsOY2YfbbiZof9pfymKELN6SOK3jIrTzleVFstqv1Yrf8p3kBN3k-CA |
ContentType | Patent |
DBID | EVB |
DatabaseName | esp@cenet |
DatabaseTitleList | |
Database_xml | – sequence: 1 dbid: EVB name: esp@cenet url: http://worldwide.espacenet.com/singleLineSearch?locale=en_EP sourceTypes: Open Access Repository |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Medicine Chemistry Sciences Physics |
DocumentTitleAlternate | 基于多模态特征提取与稠密预测的机器人抓取方法与系统 |
ExternalDocumentID | CN115578460A |
GroupedDBID | EVB |
ID | FETCH-epo_espacenet_CN115578460A3 |
IEDL.DBID | EVB |
IngestDate | Fri Jul 19 14:29:08 EDT 2024 |
IsOpenAccess | true |
IsPeerReviewed | false |
IsScholarly | false |
Language | Chinese English |
LinkModel | DirectLink |
MergedId | FETCHMERGED-epo_espacenet_CN115578460A3 |
Notes | Application Number: CN202211407718 |
OpenAccessLink | https://worldwide.espacenet.com/publicationDetails/biblio?FT=D&date=20230106&DB=EPODOC&CC=CN&NR=115578460A |
ParticipantIDs | epo_espacenet_CN115578460A |
PublicationCentury | 2000 |
PublicationDate | 20230106 |
PublicationDateYYYYMMDD | 2023-01-06 |
PublicationDate_xml | – month: 01 year: 2023 text: 20230106 day: 06 |
PublicationDecade | 2020 |
PublicationYear | 2023 |
RelatedCompanies | HUNAN UNIVERSITY |
RelatedCompanies_xml | – name: HUNAN UNIVERSITY |
Score | 3.577216 |
Snippet | The invention discloses a robot grabbing method and system based on multi-modal feature extraction and dense prediction, and the method comprises the steps:... |
SourceID | epo |
SourceType | Open Access Repository |
SubjectTerms | CALCULATING CHAMBERS PROVIDED WITH MANIPULATION DEVICES COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS COMPUTING COUNTING HAND TOOLS IMAGE DATA PROCESSING OR GENERATION, IN GENERAL MANIPULATORS PERFORMING OPERATIONS PHYSICS PORTABLE POWER-DRIVEN TOOLS TRANSPORTING |
Title | Robot grabbing method and system based on multi-modal feature extraction and dense prediction |
URI | https://worldwide.espacenet.com/publicationDetails/biblio?FT=D&date=20230106&DB=EPODOC&locale=&CC=CN&NR=115578460A |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV3dT8IwEL8gfr4pahQ_UhOzt0VgZcDDYqRjISYMQtDwYsi6dqjRjWwzJv71XssQX_T12rXdZffV3f0O4DqkQpWcW2ajbXOTWkFgcktKs94QzaDZaoQt3ZJl4Nv9B3o_bU5L8LqqhdE4oZ8aHBElKkR5z7W-XqwvsVydW5nd8BckJbfexHGNIjpGfxpDHMPtOr3R0B0ygzGH-YY_dtDxwW-T2rW7DdhUbrTC2e89dlVVyuK3SfH2YWuEq8X5AZS-niuwy1ad1yqwMyh-eFdgW2dohhkSCynMDuFpnPAkJ_M04BjXzsmyCzQJYkGWwMxE2SZBkpjofEHzPRHBG4mkBvEkqI7TZTmDfgQVTybJIlV7KuIRXHm9CeubeOLZD3tmzF-_nHUM5TiJ5QkQBQ3GKVd4f5yKTq3TppGoR7Ylwkji7FOo_r1O9b_BM9hTrNYXEfY5lPP0Q16gac75pebpN8VYlCU |
link.rule.ids | 230,309,786,891,25594,76906 |
linkProvider | European Patent Office |
linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV3dT8IwEL8gfuCbokbxqyZmb4vAyoCHxUgHQYVBCBpezLKuG2p0I9uMiX-91wLii75eu7a77L66u98BXPpUyJJzQ682TK5Tw_N0bgSBXqmKmlerV_26asnSd8zuA72b1CY5eF3Wwiic0E8FjogS5aO8Z0pfz1aXWLbKrUyv-AuS4uvO2LK1RXSM_jSGOJrdstrDgT1gGmMWczRnZKHjg98mNcs3a7Bel-i80nV6bMmqlNlvk9LZgY0hrhZlu5D7ei5CgS07rxVhq7_44V2ETZWh6adIXEhhugdPo5jHGZkmHse4dkrmXaCJFwkyB2Ym0jYJEkdE5Qvq77Hw3kgYKBBPguo4mZczqEdQ8aQBmSVyT0nch4tOe8y6Op7Y_WGPy5zVyxkHkI_iKDgEIqHBOOUS749T0Sw3GzQUldA0hB8GOPsISn-vU_pv8BwK3XG_5_Zunftj2JZsV5cS5gnks-QjOEUznfEzxd9v3KaXEg |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Apatent&rft.title=Robot+grabbing+method+and+system+based+on+multi-modal+feature+extraction+and+dense+prediction&rft.inventor=LIU+XUEBING&rft.inventor=MAO+JIANXU&rft.inventor=FENG+MINGTAO&rft.inventor=ZHU+QING&rft.inventor=YUAN+XIAOFANG&rft.inventor=ZHOU+XIAN%27EN&rft.inventor=WU+CHENGZHONG&rft.inventor=HUANG+JIANAN&rft.inventor=WANG+YAONAN&rft.inventor=ZHOU+JIAMING&rft.date=2023-01-06&rft.externalDBID=A&rft.externalDocID=CN115578460A |