OpenCalib: A multi-sensor calibration toolbox for autonomous driving
Accurate sensor calibration is a prerequisite for autonomous vehicles’ multi-sensor perception. Even though there are many open-source projects related to sensor calibration, most are designed for a specific sensor or application scenario. To this end, we propose OpenCalib, a toolbox with a rich set...
Saved in:
Published in | Software impacts Vol. 14; p. 100393 |
---|---|
Main Authors | , , , , , , , , , , , , |
Format | Journal Article |
Language | English |
Published |
Elsevier B.V
01.12.2022
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Abstract | Accurate sensor calibration is a prerequisite for autonomous vehicles’ multi-sensor perception. Even though there are many open-source projects related to sensor calibration, most are designed for a specific sensor or application scenario. To this end, we propose OpenCalib, a toolbox with a rich set of sensor calibration methods for autonomous driving vehicles. OpenCalib covers the most commonly used sensors, including LiDAR, Camera, IMU, Radar, and different application scenarios, including road-scene-based manual & automatic calibration, calibration on the production-line, and online calibration. To the best of our knowledge, OpenCalib is the first full-set open-sourced calibration toolbox specifically designed for autonomous vehicles. |
---|---|
AbstractList | Accurate sensor calibration is a prerequisite for autonomous vehicles’ multi-sensor perception. Even though there are many open-source projects related to sensor calibration, most are designed for a specific sensor or application scenario. To this end, we propose OpenCalib, a toolbox with a rich set of sensor calibration methods for autonomous driving vehicles. OpenCalib covers the most commonly used sensors, including LiDAR, Camera, IMU, Radar, and different application scenarios, including road-scene-based manual & automatic calibration, calibration on the production-line, and online calibration. To the best of our knowledge, OpenCalib is the first full-set open-sourced calibration toolbox specifically designed for autonomous vehicles. |
ArticleNumber | 100393 |
Author | Cai, Xinyu Li, Yikang Zhao, Ming Liu, Yuqian Zhong, Zebin Liu, Zhuochun Shi, Chunlei Ma, Zheng Yan, Guohang Ma, Tao Liu, Zhizheng Wang, Chengjie Wei, Pengjin |
Author_xml | – sequence: 1 givenname: Guohang surname: Yan fullname: Yan, Guohang email: yanguohang@pjlab.org.cn organization: Autonomous Driving Group, Shanghai AI Laboratory, China – sequence: 2 givenname: Zhuochun surname: Liu fullname: Liu, Zhuochun email: liuzhuochun@pjlab.org.cn organization: Autonomous Driving Group, Shanghai AI Laboratory, China – sequence: 3 givenname: Chengjie surname: Wang fullname: Wang, Chengjie email: wangchengjie@pjlab.org.cn organization: Autonomous Driving Group, Shanghai AI Laboratory, China – sequence: 4 givenname: Chunlei surname: Shi fullname: Shi, Chunlei email: shichunlei@pjlab.org.cn organization: Autonomous Driving Group, Shanghai AI Laboratory, China – sequence: 5 givenname: Pengjin surname: Wei fullname: Wei, Pengjin email: weipengjin@pjlab.org.cn organization: Autonomous Driving Group, Shanghai AI Laboratory, China – sequence: 6 givenname: Xinyu surname: Cai fullname: Cai, Xinyu email: caixinyu@pjlab.org.cn organization: Autonomous Driving Group, Shanghai AI Laboratory, China – sequence: 7 givenname: Tao surname: Ma fullname: Ma, Tao email: matao@pjlab.org.cn organization: Autonomous Driving Group, Shanghai AI Laboratory, China – sequence: 8 givenname: Zhizheng surname: Liu fullname: Liu, Zhizheng email: liuzhizheng@pjlab.org.cn organization: Autonomous Driving Group, Shanghai AI Laboratory, China – sequence: 9 givenname: Zebin surname: Zhong fullname: Zhong, Zebin email: zhongzebin@senseauto.com organization: Autonomous Driving Group, SenseTime, China – sequence: 10 givenname: Yuqian surname: Liu fullname: Liu, Yuqian email: liuyuqian@senseauto.com organization: Autonomous Driving Group, SenseTime, China – sequence: 11 givenname: Ming surname: Zhao fullname: Zhao, Ming email: zhaoming@senseauto.com organization: Autonomous Driving Group, SenseTime, China – sequence: 12 givenname: Zheng surname: Ma fullname: Ma, Zheng email: mazheng@senseauto.com organization: Autonomous Driving Group, SenseTime, China – sequence: 13 givenname: Yikang orcidid: 0000-0002-3508-510X surname: Li fullname: Li, Yikang email: liyikang@pjlab.org.cn, liyikang@senseauto.com organization: Autonomous Driving Group, Shanghai AI Laboratory, China |
BookMark | eNp9kMtKxDAUQIOM4DjOF7jpD3TMo00awcVQHRUGZqPrkCappLRJSdpB_97WunDl6l4OnMvlXIOV884AcIvgDkFE75pdtF0vdxhiPBFIOLkAa0xpnnJKitWf_QpsY2wghDhHCNFiDR5PvXGlbG11n-yTbmwHm0bjog-JmmmQg_UuGbxvK_-Z1BOX4-Cd7_wYEx3s2bqPG3BZyzaa7e_cgPfD01v5kh5Pz6_l_pgqkhVDijmBKGO8opohVdOsZirPFOEFpMxUnGumOVWMYU6RZBVGTDFNOcxUjnhWkA0gy10VfIzB1KIPtpPhSyAo5haiET8txNxCLC0m62GxzPTa2ZogorLGKaNtMGoQ2tt__W_MimmV |
CitedBy_id | crossref_primary_10_1109_JSEN_2023_3294294 crossref_primary_10_3390_app131810193 crossref_primary_10_3390_s24051575 crossref_primary_10_3390_wevj14100269 crossref_primary_10_1111_phor_12453 crossref_primary_10_3390_s23063119 crossref_primary_10_1109_LRA_2024_3371261 crossref_primary_10_3390_s23020936 |
Cites_doi | 10.3390/s110908992 10.5772/50900 10.1002/rob.21542 10.1109/34.888718 10.3390/s130201902 10.1109/ICRA40945.2020.9196627 |
ContentType | Journal Article |
Copyright | 2022 The Author(s) |
Copyright_xml | – notice: 2022 The Author(s) |
DBID | 6I. AAFTH AAYXX CITATION |
DOI | 10.1016/j.simpa.2022.100393 |
DatabaseName | ScienceDirect Open Access Titles Elsevier:ScienceDirect:Open Access CrossRef |
DatabaseTitle | CrossRef |
DatabaseTitleList | |
DeliveryMethod | fulltext_linktorsrc |
EISSN | 2665-9638 |
ExternalDocumentID | 10_1016_j_simpa_2022_100393 S2665963822000896 |
GroupedDBID | 0SF 6I. AAEDW AAFTH AALRI AAXUO AEXQZ AITUG ALMA_UNASSIGNED_HOLDINGS AMRAJ EBS EJD FDB M41 M~E NCXOZ ROL AAYXX ADVLN AFJKZ AKRWK CITATION |
ID | FETCH-LOGICAL-c348t-29301479b6d71cf64f7c54c398067eb99d7d96c772961a7b217c7d6904c519483 |
ISSN | 2665-9638 |
IngestDate | Thu Sep 26 18:39:54 EDT 2024 Thu Jul 20 20:13:11 EDT 2023 |
IsDoiOpenAccess | true |
IsOpenAccess | true |
IsPeerReviewed | true |
IsScholarly | true |
Keywords | Open-source library Autonomous driving Sensors calibration Robotics |
Language | English |
License | This is an open access article under the CC BY license. |
LinkModel | OpenURL |
MergedId | FETCHMERGED-LOGICAL-c348t-29301479b6d71cf64f7c54c398067eb99d7d96c772961a7b217c7d6904c519483 |
ORCID | 0000-0002-3508-510X |
OpenAccessLink | https://dx.doi.org/10.1016/j.simpa.2022.100393 |
ParticipantIDs | crossref_primary_10_1016_j_simpa_2022_100393 elsevier_sciencedirect_doi_10_1016_j_simpa_2022_100393 |
PublicationCentury | 2000 |
PublicationDate | December 2022 |
PublicationDateYYYYMMDD | 2022-12-01 |
PublicationDate_xml | – month: 12 year: 2022 text: December 2022 |
PublicationDecade | 2020 |
PublicationTitle | Software impacts |
PublicationYear | 2022 |
Publisher | Elsevier B.V |
Publisher_xml | – name: Elsevier B.V |
References | Barazzetti, Mussio, Remondino, Scaioni (b13) 2011 Pandey, McBride, Savarese, Eustice (b10) 2012 Zhang (b2) 2000; 22 Heikkila, Silvén (b3) 1997 Wei, Yan, Li, Fang, Liu, Cai, Yang (b14) 2022 Pandey, McBride, Savarese, Eustice (b16) 2015; 32 Gong, Lin, Liu (b15) 2013; 13 Bogdan, Eckstein, Rameau, Bazin (b20) 2018 Kato, Tokunaga, Maruyama, Maeda, Hirabayashi, Kitsukawa, Monrroy, Ando, Fujii, Azumi (b21) 2018 Atanacio-Jiménez, González-Barbosa, Hurtado-Ramos, Ornelas-Rodríguez, Jiménez-Hernández, García-Ramirez, González-Barbosa (b4) 2011; 8 Levinson, Thrun (b9) 2013 Yan, He, Shi, Cai, Li (b6) 2022 Bradski (b22) 2000 Schneider, Piewak, Stiller, Franke (b18) 2017 Ma, Liu, Yan, Li (b12) 2021 Yan, Liu, Wang, Shi, Wei, Cai, Ma, Liu, Zhong, Liu, Zhao, Ma, Li (b1) 2022 Peršić, Marković, Petrović (b8) 2017 Taylor, Nieto (b17) 2012 Y. Zhu, C. Li, Y. Zhang, Online camera-lidar calibration with sensor semantic information, in: 2020 IEEE International Conference on Robotics and Automation, ICRA, 2020, pp. 4970–4976. Muhammad, Lacroix (b5) 2010 Wang, Zheng, Xin, Ma (b7) 2011; 11 Iyer, Ram, Murthy, Krishna (b19) 2018 Barazzetti (10.1016/j.simpa.2022.100393_b13) 2011 Taylor (10.1016/j.simpa.2022.100393_b17) 2012 Bradski (10.1016/j.simpa.2022.100393_b22) 2000 Ma (10.1016/j.simpa.2022.100393_b12) 2021 Kato (10.1016/j.simpa.2022.100393_b21) 2018 Iyer (10.1016/j.simpa.2022.100393_b19) 2018 Yan (10.1016/j.simpa.2022.100393_b1) 2022 Gong (10.1016/j.simpa.2022.100393_b15) 2013; 13 Pandey (10.1016/j.simpa.2022.100393_b16) 2015; 32 Levinson (10.1016/j.simpa.2022.100393_b9) 2013 Schneider (10.1016/j.simpa.2022.100393_b18) 2017 Yan (10.1016/j.simpa.2022.100393_b6) 2022 Peršić (10.1016/j.simpa.2022.100393_b8) 2017 Wang (10.1016/j.simpa.2022.100393_b7) 2011; 11 Bogdan (10.1016/j.simpa.2022.100393_b20) 2018 Wei (10.1016/j.simpa.2022.100393_b14) 2022 Zhang (10.1016/j.simpa.2022.100393_b2) 2000; 22 Heikkila (10.1016/j.simpa.2022.100393_b3) 1997 Pandey (10.1016/j.simpa.2022.100393_b10) 2012 Atanacio-Jiménez (10.1016/j.simpa.2022.100393_b4) 2011; 8 Muhammad (10.1016/j.simpa.2022.100393_b5) 2010 10.1016/j.simpa.2022.100393_b11 |
References_xml | – year: 2022 ident: b1 article-title: Opencalib: A multi-sensor calibration toolbox for autonomous driving contributor: fullname: Li – year: 2017 ident: b18 article-title: Regnet: Multimodal sensor registration using deep neural networks contributor: fullname: Franke – year: 2012 ident: b10 article-title: Automatic targetless extrinsic calibration of a 3d lidar and camera by maximizing mutual information publication-title: AAAI contributor: fullname: Eustice – year: 2022 ident: b14 article-title: Croon: Automatic multi-lidar calibration and refinement method in road scene contributor: fullname: Yang – volume: 22 start-page: 1330 year: 2000 end-page: 1334 ident: b2 article-title: A flexible new technique for camera calibration publication-title: IEEE Trans. Pattern Anal. Mach. Intell. contributor: fullname: Zhang – start-page: 7 year: 2013 ident: b9 article-title: Automatic online calibration of cameras and lasers publication-title: Robotics: Science and Systems, vol. 2 contributor: fullname: Thrun – year: 2012 ident: b17 article-title: Automatic calibration of lidar and camera images using normalized mutual information contributor: fullname: Nieto – start-page: 5648 year: 2010 end-page: 5653 ident: b5 article-title: Calibration of a rotating multi-beam lidar publication-title: 2010 IEEE/RSJ Interna- Tional Conference on Intelligent Robots and Systems contributor: fullname: Lacroix – year: 2018 ident: b20 article-title: Deepcalib: A deep learning approach for automatic intrinsic calibration of wide field-of-view cameras publication-title: Proceedings of the 15th ACM SIGGRAPH European Conference on Visual Media Production contributor: fullname: Bazin – year: 2022 ident: b6 article-title: Joint camera intrinsic and lidar-camera extrinsic calibration contributor: fullname: Li – year: 2021 ident: b12 article-title: Crlf: Automatic calibration and refinement based on line feature for lidar and camera in road scenes contributor: fullname: Li – year: 2018 ident: b19 article-title: Calibnet: Geometrically supervised extrinsic calibration using 3d spatial transformer networks publication-title: 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems contributor: fullname: Krishna – start-page: 287 year: 2018 end-page: 296 ident: b21 article-title: Autoware on board: enabling autonomous vehicles with embedded systems publication-title: 2018 ACM/IEEE 9th International Conference on Cyber-Physical Systems contributor: fullname: Azumi – volume: 8 start-page: 59 year: 2011 ident: b4 article-title: Lidar velodyne hdl-64e calibration using pat- tern planes publication-title: Int. J. Adv. Robot. Syst. contributor: fullname: González-Barbosa – start-page: 1 year: 2017 end-page: 6 ident: b8 article-title: Extrinsic 6dof calibration of 3d lidar and radar publication-title: 2017 European Conference on Mobile Robots contributor: fullname: Petrović – start-page: 8 year: 2011 ident: b13 article-title: Targetless camera calibration, international archives of the photogrammetry publication-title: Remote Sensing and Spatial Information Sciences, vol. 38 contributor: fullname: Scaioni – volume: 13 start-page: 1902 year: 2013 end-page: 1918 ident: b15 article-title: 3D lidar-camera extrinsic calibration using an arbitrary trihedron publication-title: Sensors contributor: fullname: Liu – start-page: 1106 year: 1997 end-page: 1112 ident: b3 article-title: A four-step camera calibration procedure with implicit image correction publication-title: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition contributor: fullname: Silvén – volume: 11 start-page: 8992 year: 2011 end-page: 9008 ident: b7 article-title: Integrating millimeter wave radar with a monocular vision sensor for on-road obstacle detection applications publication-title: Sensors contributor: fullname: Ma – volume: 32 start-page: 696 year: 2015 end-page: 722 ident: b16 article-title: Automatic extrinsic calibration of vision and lidar by maximizing mutual information publication-title: J. Field Robotics contributor: fullname: Eustice – year: 2000 ident: b22 article-title: The opencv library publication-title: Dr. Dobb’s J. Softw. Tools contributor: fullname: Bradski – start-page: 287 year: 2018 ident: 10.1016/j.simpa.2022.100393_b21 article-title: Autoware on board: enabling autonomous vehicles with embedded systems contributor: fullname: Kato – volume: 11 start-page: 8992 issue: 9 year: 2011 ident: 10.1016/j.simpa.2022.100393_b7 article-title: Integrating millimeter wave radar with a monocular vision sensor for on-road obstacle detection applications publication-title: Sensors doi: 10.3390/s110908992 contributor: fullname: Wang – year: 2000 ident: 10.1016/j.simpa.2022.100393_b22 article-title: The opencv library publication-title: Dr. Dobb’s J. Softw. Tools contributor: fullname: Bradski – year: 2021 ident: 10.1016/j.simpa.2022.100393_b12 contributor: fullname: Ma – volume: 8 start-page: 59 issue: 5 year: 2011 ident: 10.1016/j.simpa.2022.100393_b4 article-title: Lidar velodyne hdl-64e calibration using pat- tern planes publication-title: Int. J. Adv. Robot. Syst. doi: 10.5772/50900 contributor: fullname: Atanacio-Jiménez – year: 2022 ident: 10.1016/j.simpa.2022.100393_b14 contributor: fullname: Wei – volume: 32 start-page: 696 issue: 5 year: 2015 ident: 10.1016/j.simpa.2022.100393_b16 article-title: Automatic extrinsic calibration of vision and lidar by maximizing mutual information publication-title: J. Field Robotics doi: 10.1002/rob.21542 contributor: fullname: Pandey – year: 2018 ident: 10.1016/j.simpa.2022.100393_b19 article-title: Calibnet: Geometrically supervised extrinsic calibration using 3d spatial transformer networks contributor: fullname: Iyer – year: 2022 ident: 10.1016/j.simpa.2022.100393_b1 contributor: fullname: Yan – volume: 22 start-page: 1330 issue: 11 year: 2000 ident: 10.1016/j.simpa.2022.100393_b2 article-title: A flexible new technique for camera calibration publication-title: IEEE Trans. Pattern Anal. Mach. Intell. doi: 10.1109/34.888718 contributor: fullname: Zhang – volume: 13 start-page: 1902 issue: 2 year: 2013 ident: 10.1016/j.simpa.2022.100393_b15 article-title: 3D lidar-camera extrinsic calibration using an arbitrary trihedron publication-title: Sensors doi: 10.3390/s130201902 contributor: fullname: Gong – year: 2022 ident: 10.1016/j.simpa.2022.100393_b6 contributor: fullname: Yan – start-page: 5648 year: 2010 ident: 10.1016/j.simpa.2022.100393_b5 article-title: Calibration of a rotating multi-beam lidar contributor: fullname: Muhammad – year: 2017 ident: 10.1016/j.simpa.2022.100393_b18 contributor: fullname: Schneider – start-page: 1 year: 2017 ident: 10.1016/j.simpa.2022.100393_b8 article-title: Extrinsic 6dof calibration of 3d lidar and radar contributor: fullname: Peršić – start-page: 7 year: 2013 ident: 10.1016/j.simpa.2022.100393_b9 article-title: Automatic online calibration of cameras and lasers contributor: fullname: Levinson – start-page: 8 year: 2011 ident: 10.1016/j.simpa.2022.100393_b13 article-title: Targetless camera calibration, international archives of the photogrammetry contributor: fullname: Barazzetti – start-page: 1106 year: 1997 ident: 10.1016/j.simpa.2022.100393_b3 article-title: A four-step camera calibration procedure with implicit image correction contributor: fullname: Heikkila – ident: 10.1016/j.simpa.2022.100393_b11 doi: 10.1109/ICRA40945.2020.9196627 – year: 2018 ident: 10.1016/j.simpa.2022.100393_b20 article-title: Deepcalib: A deep learning approach for automatic intrinsic calibration of wide field-of-view cameras contributor: fullname: Bogdan – year: 2012 ident: 10.1016/j.simpa.2022.100393_b17 contributor: fullname: Taylor – year: 2012 ident: 10.1016/j.simpa.2022.100393_b10 article-title: Automatic targetless extrinsic calibration of a 3d lidar and camera by maximizing mutual information contributor: fullname: Pandey |
SSID | ssj0002511168 |
Score | 2.3628204 |
Snippet | Accurate sensor calibration is a prerequisite for autonomous vehicles’ multi-sensor perception. Even though there are many open-source projects related to... |
SourceID | crossref elsevier |
SourceType | Aggregation Database Publisher |
StartPage | 100393 |
SubjectTerms | Autonomous driving Open-source library Robotics Sensors calibration |
Title | OpenCalib: A multi-sensor calibration toolbox for autonomous driving |
URI | https://dx.doi.org/10.1016/j.simpa.2022.100393 |
Volume | 14 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1LT4QwEG50vXgxGjW-04M3ZbNAKdSbWV8x0Ysa9URoKe5uNmBWUOPB3-605aVujHohpIECnY_pzPB9BaFdSjlzEjuAJCeiFkkgTwlcV1gsiT3pe5HwqBInX1zSsxtyfufdNSR2rS7JeVe8TdWV_Meq0AZ2VSrZP1i27hQaYB_sC1uwMGx_ZWPFBlHiKm705ZocaD1BYppN9kSkM2Ft3jzLxjx7NYzJIlc6BsV8jSfD52rmGlVq3SR_UWQwo56sA-57Uyc9LTJVYK5ZPMNCf9wYFJkYFDXMbssadH8g04fRsIbOlf6BMDQX6VgO2_UGx2lxN7Rbghnds9Rra2aQKW2VXyUtx2hrEfBUn23KB6Puk3qyrrpktzn68wrZX2aumk9YUdVGoe4kVJ2EppNZNOeAD1LO7-K9Kb-pzMrWQsn63qs1qTT779vNTI9bWrHI9SJaKJMIfGgQsYRmZLqMjmo0HOBD3MYCbmEBl1jAgAXcYAGXWFhBNyfH1_0zq_xHhiVcEuQWRGuQ5PqM09i3RULhbRMeES4LIAyRnLHYjxkVKoeiduRzyECFH1PWIwJidxK4q6iTZqlcQ9gRzOVS9qjsEeL5TsSEQ6IkSlQMLYi3jvarEQgfzVIo4Q8Dv45oNUphGc2ZKC0Ew_904sbfrrOJ5huYbqFOPinkNgSKOd_RJv8ANndmsQ |
link.rule.ids | 315,783,787,27936,27937 |
linkProvider | ISSN International Centre |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=OpenCalib%3A+A+multi-sensor+calibration+toolbox+for+autonomous+driving&rft.jtitle=Software+impacts&rft.au=Yan%2C+Guohang&rft.au=Liu%2C+Zhuochun&rft.au=Wang%2C+Chengjie&rft.au=Shi%2C+Chunlei&rft.date=2022-12-01&rft.issn=2665-9638&rft.eissn=2665-9638&rft.volume=14&rft.spage=100393&rft_id=info:doi/10.1016%2Fj.simpa.2022.100393&rft.externalDBID=n%2Fa&rft.externalDocID=10_1016_j_simpa_2022_100393 |
thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2665-9638&client=summon |
thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2665-9638&client=summon |
thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2665-9638&client=summon |