Scene Flow as a Partial Differential Equation
We reframe scene flow as the problem of estimating a continuous space and time PDE that describes motion for an entire observation sequence, represented with a neural prior. Our resulting unsupervised method, EulerFlow, produces high quality scene flow on real-world data across multiple domains, inc...
Saved in:
Published in | arXiv.org |
---|---|
Main Authors | , , , , , , , , , |
Format | Paper |
Language | English |
Published |
Ithaca
Cornell University Library, arXiv.org
02.10.2024
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Abstract | We reframe scene flow as the problem of estimating a continuous space and time PDE that describes motion for an entire observation sequence, represented with a neural prior. Our resulting unsupervised method, EulerFlow, produces high quality scene flow on real-world data across multiple domains, including large-scale autonomous driving scenes and dynamic tabletop settings. Notably, EulerFlow produces high quality flow on small, fast moving objects like birds and tennis balls, and exhibits emergent 3D point tracking behavior by solving its estimated PDE over long time horizons. On the Argoverse 2 2024 Scene Flow Challenge, EulerFlow outperforms all prior art, beating the next best unsupervised method by over 2.5x and the next best supervised method by over 10%. |
---|---|
AbstractList | We reframe scene flow as the problem of estimating a continuous space and time PDE that describes motion for an entire observation sequence, represented with a neural prior. Our resulting unsupervised method, EulerFlow, produces high quality scene flow on real-world data across multiple domains, including large-scale autonomous driving scenes and dynamic tabletop settings. Notably, EulerFlow produces high quality flow on small, fast moving objects like birds and tennis balls, and exhibits emergent 3D point tracking behavior by solving its estimated PDE over long time horizons. On the Argoverse 2 2024 Scene Flow Challenge, EulerFlow outperforms all prior art, beating the next best unsupervised method by over 2.5x and the next best supervised method by over 10%. |
Author | Li, Siyi Eaton, Eric Wang, Yue Yu, Zhiding Ramanan, Deva Pehserl, Joachim Khatri, Ishan Vedder, Kyle Kocamaz, Mehmet Peri, Neehar |
Author_xml | – sequence: 1 givenname: Kyle surname: Vedder fullname: Vedder, Kyle – sequence: 2 givenname: Neehar surname: Peri fullname: Peri, Neehar – sequence: 3 givenname: Ishan surname: Khatri fullname: Khatri, Ishan – sequence: 4 givenname: Siyi surname: Li fullname: Li, Siyi – sequence: 5 givenname: Eric surname: Eaton fullname: Eaton, Eric – sequence: 6 givenname: Mehmet surname: Kocamaz fullname: Kocamaz, Mehmet – sequence: 7 givenname: Yue surname: Wang fullname: Wang, Yue – sequence: 8 givenname: Zhiding surname: Yu fullname: Yu, Zhiding – sequence: 9 givenname: Deva surname: Ramanan fullname: Ramanan, Deva – sequence: 10 givenname: Joachim surname: Pehserl fullname: Pehserl, Joachim |
BookMark | eNrjYmDJy89LZWLgNDI2NtS1MDEy4mDgLS7OMjAwMDIzNzI1NeZk0A1OTs1LVXDLyS9XSCxWSFQISCwqyUzMUXDJTEtLLUrNA3NcC0sTSzLz83gYWNMSc4pTeaE0N4Oym2uIs4duQVF-YWlqcUl8Vn5pUR5QKt7Y0NDI0szMwtzMmDhVAJcyMy0 |
ContentType | Paper |
Copyright | 2024. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. |
Copyright_xml | – notice: 2024. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. |
DBID | 8FE 8FG ABJCF ABUWG AFKRA AZQEC BENPR BGLVJ CCPQU DWQXO HCIFZ L6V M7S PIMPY PQEST PQQKQ PQUKI PRINS PTHSS |
DatabaseName | ProQuest SciTech Collection ProQuest Technology Collection Materials Science & Engineering Collection ProQuest Central (Alumni) ProQuest Central ProQuest Central Essentials ProQuest Central Technology Collection ProQuest One Community College ProQuest Central Korea SciTech Premium Collection ProQuest Engineering Collection Engineering Database Publicly Available Content Database ProQuest One Academic Eastern Edition (DO NOT USE) ProQuest One Academic ProQuest One Academic UKI Edition ProQuest Central China Engineering Collection |
DatabaseTitle | Publicly Available Content Database Engineering Database Technology Collection ProQuest Central Essentials ProQuest One Academic Eastern Edition ProQuest Central (Alumni Edition) SciTech Premium Collection ProQuest One Community College ProQuest Technology Collection ProQuest SciTech Collection ProQuest Central China ProQuest Central ProQuest Engineering Collection ProQuest One Academic UKI Edition ProQuest Central Korea Materials Science & Engineering Collection ProQuest One Academic Engineering Collection |
DatabaseTitleList | Publicly Available Content Database |
Database_xml | – sequence: 1 dbid: 8FG name: ProQuest Technology Collection url: https://search.proquest.com/technologycollection1 sourceTypes: Aggregation Database |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Physics |
EISSN | 2331-8422 |
Genre | Working Paper/Pre-Print |
GroupedDBID | 8FE 8FG ABJCF ABUWG AFKRA ALMA_UNASSIGNED_HOLDINGS AZQEC BENPR BGLVJ CCPQU DWQXO FRJ HCIFZ L6V M7S M~E PIMPY PQEST PQQKQ PQUKI PRINS PTHSS |
ID | FETCH-proquest_journals_31129668763 |
IEDL.DBID | BENPR |
IngestDate | Thu Oct 10 21:03:14 EDT 2024 |
IsOpenAccess | true |
IsPeerReviewed | false |
IsScholarly | false |
Language | English |
LinkModel | DirectLink |
MergedId | FETCHMERGED-proquest_journals_31129668763 |
OpenAccessLink | https://www.proquest.com/docview/3112966876?pq-origsite=%requestingapplication% |
PQID | 3112966876 |
PQPubID | 2050157 |
ParticipantIDs | proquest_journals_3112966876 |
PublicationCentury | 2000 |
PublicationDate | 20241002 |
PublicationDateYYYYMMDD | 2024-10-02 |
PublicationDate_xml | – month: 10 year: 2024 text: 20241002 day: 02 |
PublicationDecade | 2020 |
PublicationPlace | Ithaca |
PublicationPlace_xml | – name: Ithaca |
PublicationTitle | arXiv.org |
PublicationYear | 2024 |
Publisher | Cornell University Library, arXiv.org |
Publisher_xml | – name: Cornell University Library, arXiv.org |
SSID | ssj0002672553 |
Score | 3.5742178 |
SecondaryResourceType | preprint |
Snippet | We reframe scene flow as the problem of estimating a continuous space and time PDE that describes motion for an entire observation sequence, represented with a... |
SourceID | proquest |
SourceType | Aggregation Database |
SubjectTerms | Moving object recognition Partial differential equations Three dimensional flow |
Title | Scene Flow as a Partial Differential Equation |
URI | https://www.proquest.com/docview/3112966876 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1LSwMxEB5sF8GbT9TWEtBrcPPYrD0J6q5FaFl8QG8lm6SnYh9b8eZvdxJTPQg9hkAS8vi-LzOTDMCVUIKp1DgqrfDWqr6kmhtGayRHbrOUTbl_nDwcqcGbfBpn42hwa2JY5QYTA1DbufE28mvhhYFSeHhvF0vqs0Z572pModGChDPp3bTJXTGqnn-tLFzlqJnFP6AN7FHuQ1LphVsdwI57P4TdEHRpmiOgLwaRhpSz-SfRDdGk8uuoZ-QhZi0JhWL58xv3MVyWxev9gG76mMR90Ez-Ri1OoI0XencKxAg9lbmyNbNWZg4lfVZnuUWhJa22Lj2D7raWzrdXd2CPI_GGgDPehfZ69eEukDjXdQ9aN-VjL84RloZfxTdR9XcM |
link.rule.ids | 786,790,12792,21416,33406,33777,43633,43838 |
linkProvider | ProQuest |
linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1bS8MwFD5oi7g3r3iZGtDXYJtb55OgtlTdStEJeytpkj2N3Trx75vUTB-EPYZAEnL5vpMvJ-cA3FBBYxEpg5mmTq26Y1gSFePakiPRPIrHxH1OHhQi_2AvIz7yglvj3SrXmNgCtZ4pp5HfUmcYCGEP7_18gV3WKPe66lNobEPoQm72Aggf0qJ8-1VZiEiszUz_AW3LHtkehKWcm-U-bJnpAey0TpeqOQT8rizSoGwy-0KyQRKVbh3lBD35rCVtIV38ROM-gussHT7meN1H5fdBU_2Nmh5DYC_05gSQonLMEqHrWGvGjTXpec0TbQ0tpqU20Sl0N7V0trn6Cnbz4aBf9Z-L13PoEEvCrfMZ6UKwWn6aC0uiq_rSz9Q3d9x36w |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Scene+Flow+as+a+Partial+Differential+Equation&rft.jtitle=arXiv.org&rft.au=Vedder%2C+Kyle&rft.au=Peri%2C+Neehar&rft.au=Khatri%2C+Ishan&rft.au=Li%2C+Siyi&rft.date=2024-10-02&rft.pub=Cornell+University+Library%2C+arXiv.org&rft.eissn=2331-8422 |