A Metric on the Space of Finite Sets of Trajectories for Evaluation of Multi-Target Tracking Algorithms
In this article, we propose a metric on the space of finite sets of trajectories for assessing multi-target tracking algorithms in a mathematically sound way. The main use of the metric is to compare estimates of trajectories from different algorithms with the ground truth of trajectories. The propo...
Saved in:
| Published in | IEEE transactions on signal processing Vol. 68; pp. 3917 - 3928 |
|---|---|
| Main Authors | , , |
| Format | Journal Article |
| Language | English |
| Published |
New York
IEEE
2020
The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| Subjects | |
| Online Access | Get full text |
Cover
Loading…
| Abstract | In this article, we propose a metric on the space of finite sets of trajectories for assessing multi-target tracking algorithms in a mathematically sound way. The main use of the metric is to compare estimates of trajectories from different algorithms with the ground truth of trajectories. The proposed metric includes intuitive costs associated to localization error for properly detected targets, missed and false targets and track switches at each time step. The metric computation is based on solving a multi-dimensional assignment problem. We also propose a lower bound for the metric, which is also a metric for sets of trajectories and is computable in polynomial time using linear programming. We also extend the proposed metrics on sets of trajectories to random finite sets of trajectories. |
|---|---|
| AbstractList | In this article, we propose a metric on the space of finite sets of trajectories for assessing multi-target tracking algorithms in a mathematically sound way. The main use of the metric is to compare estimates of trajectories from different algorithms with the ground truth of trajectories. The proposed metric includes intuitive costs associated to localization error for properly detected targets, missed and false targets and track switches at each time step. The metric computation is based on solving a multi-dimensional assignment problem. We also propose a lower bound for the metric, which is also a metric for sets of trajectories and is computable in polynomial time using linear programming. We also extend the proposed metrics on sets of trajectories to random finite sets of trajectories. |
| Author | Svensson, Lennart Garcia-Fernandez, Angel F. Rahmathullah, Abu Sajana |
| Author_xml | – sequence: 1 givenname: Angel F. orcidid: 0000-0002-6471-8455 surname: Garcia-Fernandez fullname: Garcia-Fernandez, Angel F. email: angel.garcia-fernandez@liverpool.ac.uk organization: Department of Electrical Engineering and Electronics, University of Liverpool, Liverpool, U.K – sequence: 2 givenname: Abu Sajana orcidid: 0000-0003-0225-0743 surname: Rahmathullah fullname: Rahmathullah, Abu Sajana email: abusajana@gmail.com organization: Zenuity AB, Gothenburg, Sweden – sequence: 3 givenname: Lennart orcidid: 0000-0003-0206-9186 surname: Svensson fullname: Svensson, Lennart email: lennart.svensson@chalmers.se organization: Department of Signals and Systems, Chalmers University of Technology, Gothenburg, Sweden |
| BackLink | https://research.chalmers.se/publication/518545$$DView record from Swedish Publication Index |
| BookMark | eNo9kV1PIyEYhYlxEz_WexNvSLyeCgwfM5eNUddEs5u0m-wdAXxpqdOhAqPx3y9NjVdw4JzzQp4zdDzGERC6pGRGKelvlos_M0YYmbWEiJb0R-iU9pw2hCt5XPf1sBGd-neCznLeEEI57-UpWs3xM5QUHI4jLmvAi51xgKPH92EMpWooeS-XyWzAlZgCZOxjwnfvZphMCTVXr5-noYRmadIKyt7rXsO4wvNhVQNlvc0_0Q9vhgwXX-s5-nt_t7z91Tz9fni8nT81rpWqNMobzjmTUryI3nfegrGCtB1TIChz1hCiBBMMqJe0FawaPH9x1BjHO8Zte44Wh978AbvJ6l0KW5M-dTRBJ8hgkltrtzbDFlLWGTSXzhvZC-0ZV1VZojtirTa0rS-Rilrra-v1oXWX4tsEuehNnNJYP6IZZ5x2HetYdZGDy6WYcwL_PZ0SvYekKyS9h6S_INXI1SESAODb3lOmKrz2P478jxU |
| CODEN | ITPRED |
| CitedBy_id | crossref_primary_10_1109_JSEN_2023_3270272 crossref_primary_10_1109_TSP_2022_3184794 crossref_primary_10_3390_electronics13010191 crossref_primary_10_1109_TSP_2021_3132232 crossref_primary_10_1109_JSEN_2023_3348155 crossref_primary_10_1109_TSP_2021_3100999 crossref_primary_10_1016_j_dsp_2024_104585 crossref_primary_10_1109_JSEN_2023_3285885 crossref_primary_10_2139_ssrn_4012313 crossref_primary_10_3390_s22228613 crossref_primary_10_1016_j_inffus_2023_102187 crossref_primary_10_1109_TAES_2023_3329462 crossref_primary_10_1016_j_dsp_2024_104513 crossref_primary_10_7498_aps_72_20230124 crossref_primary_10_2139_ssrn_4075417 crossref_primary_10_1007_s11042_022_12189_4 crossref_primary_10_1109_TAES_2022_3168252 crossref_primary_10_1016_j_sigpro_2022_108894 crossref_primary_10_1016_j_sigpro_2022_108772 crossref_primary_10_1109_JSEN_2024_3386314 crossref_primary_10_1109_TSP_2020_3028496 crossref_primary_10_1016_j_sigpro_2022_108675 crossref_primary_10_1016_j_sigpro_2024_109401 crossref_primary_10_1109_TAES_2023_3317233 crossref_primary_10_1109_TSP_2022_3165947 crossref_primary_10_1016_j_dsp_2022_103786 crossref_primary_10_1109_JSTARS_2021_3071625 crossref_primary_10_1109_LSP_2024_3416824 crossref_primary_10_1109_ACCESS_2024_3389824 crossref_primary_10_1109_TVT_2023_3310742 crossref_primary_10_3390_app12136388 crossref_primary_10_1109_TSP_2020_3017046 crossref_primary_10_1109_TVT_2022_3174055 crossref_primary_10_1016_j_cja_2023_08_024 |
| Cites_doi | 10.1137/1.9780898717754 10.1109/ISSNIP.2013.6529803 10.1109/TAES.2018.2805153 10.1109/TIT.1967.1054010 10.1109/TPAMI.2010.108 10.21236/ADA447010 10.1109/PROC.1973.9030 10.1109/LSP.2015.2410217 10.1109/TAES.2019.2921210 10.1109/TSP.2014.2370946 10.1109/IFIC.2000.862699 10.23919/ICIF.2017.8009645 10.1109/TAES.2006.314596 10.1109/PACRIM.1993.407232 10.1109/TSP.2011.2140111 10.23919/ICIF.2018.8455849 10.1007/978-0-8176-4998-2 10.1016/0041-5553(80)90061-0 10.1214/lnms/1215467407 10.1109/TSP.2011.2135346 10.1239/aap/1222868180 10.1007/978-1-4614-4869-3 10.1155/2008/246309 10.1109/TSP.2019.2943234 10.1109/ICIF.2010.5712056 10.1109/ICIF.2003.177339 10.1145/585265.585268 10.1109/TSP.2014.2364013 |
| ContentType | Journal Article |
| Copyright | Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2020 |
| Copyright_xml | – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2020 |
| DBID | 97E RIA RIE AAYXX CITATION 7SC 7SP 8FD JQ2 L7M L~C L~D ADTPV AOWAS F1S |
| DOI | 10.1109/TSP.2020.3005309 |
| DatabaseName | IEEE All-Society Periodicals Package (ASPP) 2005-present IEEE All-Society Periodicals Package (ASPP) 1998–Present IEEE Electronic Library Online CrossRef Computer and Information Systems Abstracts Electronics & Communications Abstracts Technology Research Database ProQuest Computer Science Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional SwePub SwePub Articles SWEPUB Chalmers tekniska högskola |
| DatabaseTitle | CrossRef Technology Research Database Computer and Information Systems Abstracts – Academic Electronics & Communications Abstracts ProQuest Computer Science Collection Computer and Information Systems Abstracts Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Professional |
| DatabaseTitleList | Technology Research Database |
| Database_xml | – sequence: 1 dbid: RIE name: IEEE Electronic Library Online url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/ sourceTypes: Publisher |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Engineering |
| EISSN | 1941-0476 |
| EndPage | 3928 |
| ExternalDocumentID | oai_research_chalmers_se_46cfa695_f247_46b0_80bb_a13444671bbf 10_1109_TSP_2020_3005309 9127194 |
| Genre | orig-research |
| GroupedDBID | -~X .DC 0R~ 29I 3EH 4.4 53G 5GY 5VS 6IK 85S 97E AAJGR AASAJ AAYOK ABFSI ABQJQ ABVLG ACGFO ACIWK ACKIV ACNCT AENEX AETIX AI. AIBXA AJQPL AKJIK ALLEH ALMA_UNASSIGNED_HOLDINGS ASUFR ATWAV BEFXN BFFAM BGNUA BKEBE BPEOZ CS3 E.L EBS EJD F5P HZ~ H~9 ICLAB IFIPE IFJZH IPLJI JAVBF LAI MS~ O9- OCL P2P RIA RIE RIG RNS TAE TN5 VH1 XFK AAYXX CITATION 7SC 7SP 8FD JQ2 L7M L~C L~D ADTPV AOWAS F1S |
| ID | FETCH-LOGICAL-c367t-7fa4442665d59f8fbeab503827e512cba0075252e1f61352fbef4dc1aac4824b3 |
| IEDL.DBID | RIE |
| ISSN | 1053-587X 1941-0476 |
| IngestDate | Sat Aug 24 00:39:03 EDT 2024 Thu Oct 10 16:53:19 EDT 2024 Fri Aug 23 01:20:52 EDT 2024 Mon Jul 08 05:38:53 EDT 2024 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c367t-7fa4442665d59f8fbeab503827e512cba0075252e1f61352fbef4dc1aac4824b3 |
| ORCID | 0000-0002-6471-8455 0000-0003-0206-9186 0000-0003-0225-0743 |
| PQID | 2424188282 |
| PQPubID | 85478 |
| PageCount | 12 |
| ParticipantIDs | crossref_primary_10_1109_TSP_2020_3005309 swepub_primary_oai_research_chalmers_se_46cfa695_f247_46b0_80bb_a13444671bbf proquest_journals_2424188282 ieee_primary_9127194 |
| PublicationCentury | 2000 |
| PublicationDate | 20200000 2020-00-00 20200101 2020 |
| PublicationDateYYYYMMDD | 2020-01-01 |
| PublicationDate_xml | – year: 2020 text: 20200000 |
| PublicationDecade | 2020 |
| PublicationPlace | New York |
| PublicationPlace_xml | – name: New York |
| PublicationTitle | IEEE transactions on signal processing |
| PublicationTitleAbbrev | TSP |
| PublicationYear | 2020 |
| Publisher | IEEE The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| Publisher_xml | – name: IEEE – name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| References | ref12 ref15 fridling (ref8) 0 ref10 papadimitriou (ref42) 1998 ref17 ref16 ref19 ref18 schuhmacher (ref6) 2008 knapp (ref51) 2005 ref50 rudin (ref34) 1964; 3 george (ref43) 1981 ref45 ref48 ref41 ref44 rothrock (ref9) 0; 4048 ref49 blom (ref36) 0 bento (ref21) 2018 ref5 yianilos (ref20) 1993; 93 ref35 ref37 mahler (ref1) 2007 ref31 xia (ref46) 2019 ref30 ref2 ref39 blackman (ref7) 1999 fortunato (ref33) 0 garcía-fernández (ref13) 2019 sontag (ref40) 2011; 1 apostol (ref4) 1974 drummond (ref11) 0 ref24 coraluppi (ref32) 2000 ref23 ref26 xia (ref47) 2019; 14 ref25 ref22 ref28 diaconis (ref38) 1988 ref29 vu (ref14) 0 mahler (ref3) 2014 garey (ref27) 1979; 29 |
| References_xml | – ident: ref28 doi: 10.1137/1.9780898717754 – year: 1981 ident: ref43 publication-title: Computer Solutions of Large Sparse Positive Definite Systems contributor: fullname: george – year: 2014 ident: ref3 publication-title: Advances in Statistical Multisource-Multitarget Information Fusion contributor: fullname: mahler – ident: ref15 doi: 10.1109/ISSNIP.2013.6529803 – ident: ref48 doi: 10.1109/TAES.2018.2805153 – ident: ref39 doi: 10.1109/TIT.1967.1054010 – ident: ref41 doi: 10.1109/TPAMI.2010.108 – ident: ref18 doi: 10.21236/ADA447010 – ident: ref29 doi: 10.1109/PROC.1973.9030 – ident: ref23 doi: 10.1109/LSP.2015.2410217 – year: 2005 ident: ref51 publication-title: Basic Real Analysis contributor: fullname: knapp – start-page: 1 year: 2000 ident: ref32 article-title: All-source track and identity fusion publication-title: Proc MSS Nat Symp Sensor Data Fusion contributor: fullname: coraluppi – ident: ref2 doi: 10.1109/TAES.2019.2921210 – ident: ref24 doi: 10.1109/TSP.2014.2370946 – start-page: 326 year: 0 ident: ref11 article-title: Ambiguities in evaluating performance of multiple target tracking algorithms publication-title: Proc SPIE Conf contributor: fullname: drummond – ident: ref31 doi: 10.1109/IFIC.2000.862699 – ident: ref12 doi: 10.23919/ICIF.2017.8009645 – volume: 29 year: 1979 ident: ref27 publication-title: Computers and Intractability contributor: fullname: garey – volume: 14 start-page: 213 year: 2019 ident: ref47 article-title: Multi-scan implementation of the trajectory Poisson multi-Bernoulli mixture filter publication-title: J Adv Inf Fusion contributor: fullname: xia – ident: ref26 doi: 10.1109/TAES.2006.314596 – ident: ref10 doi: 10.1109/PACRIM.1993.407232 – ident: ref16 doi: 10.1109/TSP.2011.2140111 – volume: 1 start-page: 219 year: 2011 ident: ref40 article-title: Introduction to dual decomposition for inference publication-title: Opt Mach Learn contributor: fullname: sontag – volume: 3 year: 1964 ident: ref34 publication-title: Principles of Mathematical Analysis contributor: fullname: rudin – ident: ref45 doi: 10.23919/ICIF.2018.8455849 – start-page: 1 year: 2019 ident: ref46 article-title: Extended target Poisson multi-Bernoulli mixture trackers based on sets of trajectories publication-title: Proc 22nd Int Conf Inf Fusion contributor: fullname: xia – start-page: 1 year: 2019 ident: ref13 article-title: Spooky effect in optimal OSPA estimation and how GOSPA solves it publication-title: Proc 22nd Int Conf Inf Fusion contributor: fullname: garcía-fernández – year: 2018 ident: ref21 article-title: A metric for sets of trajectories that is practical and mathematically consistent contributor: fullname: bento – ident: ref49 doi: 10.1007/978-0-8176-4998-2 – ident: ref30 doi: 10.1016/0041-5553(80)90061-0 – year: 1974 ident: ref4 publication-title: Mathematical Analysis contributor: fullname: apostol – year: 1988 ident: ref38 publication-title: Group Representations in Probability and Statistics doi: 10.1214/lnms/1215467407 contributor: fullname: diaconis – ident: ref37 doi: 10.1109/TSP.2011.2135346 – start-page: 1 year: 0 ident: ref14 article-title: A new performance metric for multiple target tracking based on optimal subpattern assignment publication-title: Proc 17th Int Conf Inf Fusion contributor: fullname: vu – year: 1998 ident: ref42 publication-title: Combinatorial Optimization Algorithms and Complexity contributor: fullname: papadimitriou – start-page: 371 year: 0 ident: ref8 article-title: Performance evaluation methods for multiple-target-tracking algorithms publication-title: Proc SPIE 1481 Signal Data Process Small Targets contributor: fullname: fridling – start-page: 1 year: 0 ident: ref33 article-title: Generalized Murty's algorithm with application to multiple hypothesis tracking publication-title: Proc Int Conf Inf Fusion contributor: fullname: fortunato – year: 2007 ident: ref1 publication-title: Statistical Multisource-Multitarget Information Fusion contributor: fullname: mahler – ident: ref5 doi: 10.1239/aap/1222868180 – ident: ref50 doi: 10.1007/978-1-4614-4869-3 – start-page: 1 year: 2008 ident: ref6 article-title: On performance evaluation of multi-object filters publication-title: 2008 11th International Conference on Information Fusion FUSION contributor: fullname: schuhmacher – ident: ref17 doi: 10.1155/2008/246309 – ident: ref44 doi: 10.1109/TSP.2019.2943234 – ident: ref22 doi: 10.1109/ICIF.2010.5712056 – ident: ref25 doi: 10.1109/ICIF.2003.177339 – ident: ref19 doi: 10.1145/585265.585268 – ident: ref35 doi: 10.1109/TSP.2014.2364013 – volume: 93 start-page: 311 year: 1993 ident: ref20 article-title: Data structures and algorithms for nearest neighbor search in general metric spaces publication-title: SODA contributor: fullname: yianilos – volume: 4048 start-page: 521 year: 0 ident: ref9 article-title: Performance metrics for multiple-sensor multiple-target tracking publication-title: Proc SPIE Conf Signal Data Process Small Targets contributor: fullname: rothrock – year: 1999 ident: ref7 publication-title: Design and Analysis of Modern Tracking Systems contributor: fullname: blackman – start-page: 1 year: 0 ident: ref36 article-title: Tracking closely spaced targets: Bayes outperformed by an approximation publication-title: Proc IEEE Int Conf Inf Fusion contributor: fullname: blom |
| SSID | ssj0014496 |
| Score | 2.5494235 |
| Snippet | In this article, we propose a metric on the space of finite sets of trajectories for assessing multi-target tracking algorithms in a mathematically sound way.... |
| SourceID | swepub proquest crossref ieee |
| SourceType | Open Access Repository Aggregation Database Publisher |
| StartPage | 3917 |
| SubjectTerms | Algorithms Error detection Ground truth Linear programming Lower bounds Metrics Monte Carlo methods Multiple target tracking Operations research Polynomials random finite sets sets of trajectories Signal processing algorithms Switches Target detection Target tracking Trajectory Trajectory analysis |
| Title | A Metric on the Space of Finite Sets of Trajectories for Evaluation of Multi-Target Tracking Algorithms |
| URI | https://ieeexplore.ieee.org/document/9127194 https://www.proquest.com/docview/2424188282 https://research.chalmers.se/publication/518545 |
| Volume | 68 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1Bb9MwFLa2neDAgIHoGMgHLki4Sxw7to8VWjUhhpDaSb1ZtmOvMGgRSS_8et5z0qggDtxixYkcP0fv-56fv0fIm4o3wGSlYzLWmglwyczXOrHksbZ11KVKOcv3U319Kz6s5OqIvBvPwsQYc_JZnOJl3stvtmGHobJLU3IFpPuYHCtj-rNa446BELkWF8CFikmtVvstycJcLhefgQhy4Ke45DD18MAF5Zoqf8LLQ8nQ7Gbmp-RmP8A-u-R-uuv8NPz6S7vxf7_gMXk04E066xfIE3IUN0_JwwMVwjNyN6M3WFcr0O2GAh6kC-DRkW4TnX9BREoXsWuxCX7taw7yA7umAHbp1SgVjrfzWV62zKnl2DdgFJ7Ovt3BA936e_uM3M6vlu-v2VB_gYWqVh1TyQmBHlw20iSdfHQe1WO4igATgneIN7jksUwACiSHDkk0oXQuCM2Fr56Tk812E18Qql2syhikKhoFHCsYeI_xAL2KKqVUNBPydm8S-6OX2bCZnhTGgvksms8O5puQM5zYsd8wpxNysbehHf7D1uLhlxJIhOYT8rG36_gcCmsPikprG9a5XE1r22hFHZKrjbSJCwUtX1hdeG9dWcF81Kr0Pp3_exAvyQMcah-juSAn3c9dfAWopfOv83L9DcMV6Ow |
| link.rule.ids | 230,315,783,787,799,888,4031,27935,27936,27937,55086 |
| linkProvider | IEEE |
| linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1Nj9MwEB0tywE48LWgLSzgAxck0k0cO3aOFdqqQLtCalfqzYode7vAtoikF349M05aFcSBW6w4keNxNO-Nx28A3ua8RiYrq0T6QicCXXJiCx2SYKm2tdeZCjHL97KYXIlPS7k8gvf7szDe-5h85od0Gffy643bUqjsvMy4QtJ9B-4irtZFd1prv2cgRKzGhYAhT6RWy92mZFqeL-ZfkApyZKi06Cj58MAJxaoqfwLMQ9HQ6GjGj2C2G2KXX_JtuG3t0P36S73xf7_hMTzsEScbdUvkCRz59VN4cKBDeALXIzajylqObdYMESGbI5P2bBPY-IYwKZv7tqEmeravMcyP_Joh3GUXe7Fwuh1P8yaLmFxOfR3F4dno-zU-0K5um2dwNb5YfJgkfQWGxOWFahMVKiHIh8talkEH6ytL-jFceQQKzlaEOLjkPgsICyTHDkHULqsqJzQXNn8Ox-vN2p8C05XPM--kSmuFLMuV-J7SIvhK8xBCWg_g3c4k5kcntGEiQUlLg-YzZD7Tm28AJzSx-379nA7gbGdD0_-JjaHjLxnSCM0HMO3sun-OpLV7TaWVcatYsKYxjTeicKEqSmkCFwpbNjU6tdZUWY7zUajM2vDi34N4A_cmi9nUTD9efn4J92nYXcTmDI7bn1v_CjFMa1_HpfsbFCrsNw |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+Metric+on+the+Space+of+Finite+Sets+of+Trajectories+for+Evaluation+of+Multi-Target+Tracking+Algorithms&rft.jtitle=IEEE+transactions+on+signal+processing&rft.au=Garcia-Fernandez%2C+Angel+F.&rft.au=Rahmathullah%2C+Abu+Sajana&rft.au=Svensson%2C+Lennart&rft.date=2020&rft.pub=IEEE&rft.issn=1053-587X&rft.eissn=1941-0476&rft.volume=68&rft.spage=3917&rft.epage=3928&rft_id=info:doi/10.1109%2FTSP.2020.3005309&rft.externalDocID=9127194 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1053-587X&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1053-587X&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1053-587X&client=summon |