Cross-modality image generation
Systems, devices, methods, and computer-readable media for image processing by machine learning are provided. A method includes providing, as input to a first machine learning (ML) model trained based on image and corresponding depth data, data of a first image, the first image captured by a sensor...
Saved in:
Main Authors | , |
---|---|
Format | Patent |
Language | English |
Published |
07.06.2022
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Abstract | Systems, devices, methods, and computer-readable media for image processing by machine learning are provided. A method includes providing, as input to a first machine learning (ML) model trained based on image and corresponding depth data, data of a first image, the first image captured by a sensor of a first modality. The method includes receiving, from the ML model, an estimated depth per pixel of the first image. The method includes providing, as input to a second ML model trained based on the first image and a loss in constructing an estimated second image in a second modality, the first image and receiving, from the second ML model, estimated transformation parameters that transform the first image from the first modality to the second modality. The method includes using the estimated transformation parameters and the estimated depth to generate an estimated second image in the second modality. |
---|---|
AbstractList | Systems, devices, methods, and computer-readable media for image processing by machine learning are provided. A method includes providing, as input to a first machine learning (ML) model trained based on image and corresponding depth data, data of a first image, the first image captured by a sensor of a first modality. The method includes receiving, from the ML model, an estimated depth per pixel of the first image. The method includes providing, as input to a second ML model trained based on the first image and a loss in constructing an estimated second image in a second modality, the first image and receiving, from the second ML model, estimated transformation parameters that transform the first image from the first modality to the second modality. The method includes using the estimated transformation parameters and the estimated depth to generate an estimated second image in the second modality. |
Author | Bongio Karrman, Anton Fan, Ryan C |
Author_xml | – fullname: Bongio Karrman, Anton – fullname: Fan, Ryan C |
BookMark | eNrjYmDJy89L5WSQdy7KLy7Wzc1PSczJLKlUyMxNTE9VSE_NSy1KLMnMz-NhYE1LzClO5YXS3AyKbq4hzh66qQX58anFBYnJQKUl8aHBhobGpibm5kZORsbEqAEAFxcm_Q |
ContentType | Patent |
DBID | EVB |
DatabaseName | esp@cenet |
DatabaseTitleList | |
Database_xml | – sequence: 1 dbid: EVB name: esp@cenet url: http://worldwide.espacenet.com/singleLineSearch?locale=en_EP sourceTypes: Open Access Repository |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Medicine Chemistry Sciences Physics |
ExternalDocumentID | US11354772B2 |
GroupedDBID | EVB |
ID | FETCH-epo_espacenet_US11354772B23 |
IEDL.DBID | EVB |
IngestDate | Fri Jul 19 12:57:06 EDT 2024 |
IsOpenAccess | true |
IsPeerReviewed | false |
IsScholarly | false |
Language | English |
LinkModel | DirectLink |
MergedId | FETCHMERGED-epo_espacenet_US11354772B23 |
Notes | Application Number: US202016935646 |
OpenAccessLink | https://worldwide.espacenet.com/publicationDetails/biblio?FT=D&date=20220607&DB=EPODOC&CC=US&NR=11354772B2 |
ParticipantIDs | epo_espacenet_US11354772B2 |
PublicationCentury | 2000 |
PublicationDate | 20220607 |
PublicationDateYYYYMMDD | 2022-06-07 |
PublicationDate_xml | – month: 06 year: 2022 text: 20220607 day: 07 |
PublicationDecade | 2020 |
PublicationYear | 2022 |
RelatedCompanies | Raytheon Company |
RelatedCompanies_xml | – name: Raytheon Company |
Score | 3.409277 |
Snippet | Systems, devices, methods, and computer-readable media for image processing by machine learning are provided. A method includes providing, as input to a first... |
SourceID | epo |
SourceType | Open Access Repository |
SubjectTerms | CALCULATING COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS COMPUTING COUNTING IMAGE DATA PROCESSING OR GENERATION, IN GENERAL PHYSICS |
Title | Cross-modality image generation |
URI | https://worldwide.espacenet.com/publicationDetails/biblio?FT=D&date=20220607&DB=EPODOC&locale=&CC=US&NR=11354772B2 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV3dS8MwED_G_HzTquj8qiB9K65N2rQPRWjaMoR94FbZ22jSdkzYB7biv28SOueLvl7gcjm4r-TuF4DHEtnEKSVsKHOwiV2UmZ7HPTPHvEuyjKDcksPJ_YHbS_HL1Jm24H07C6NwQr8UOKKwKC7svVb-erO7xIpUb2X1xBaCtH5OJkFkNNWxbXfdLjGiMIhHw2hIDUqDdGwMXgPLQg4WmWQo3PWeTKMlzn78FsqplM3vkJKcwP5IcFvVp9AqVhoc0e3Paxoc9psHbw0OVIcmrwSxscLqDO6pDG3mcp2rJFpfLIVT0OcKQFqKfg4PSTyhPVPsOfs54Cwd78RDF9AWhX9xCToRuYGPWJm53Me5ZbHC4khCkHmuX9jMv4LO33w6_y1ew7FUlmp5IjfQrj8-i1sRXGt2p7TyDbJUfKw |
link.rule.ids | 230,309,786,891,25594,76903 |
linkProvider | European Patent Office |
linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1LS8NAEB5KfdSbVqXWRytIbsEku8kmhyAkaanaF7aV3kKySaRCH5iIf9_ZJbVe9DoLs7MD89qd-RbgLiMGMzMBGxqbVKUWiVTb5raaUK6xKGIk0cVw8mBo9Wb0aW7OK_C-nYWROKFfEhwRLYqjvRfSX292l1iB7K3M7-MFktYP3akbKGV1bBiapTEl8NzOeBSMfMX33dlEGb64uk5Mipmkh-56j2FJKEulV09MpWx-h5TuMeyPkduqOIFKuqpDzd_-vFaHw0H54F2HA9mhyXMkllaYn0LLF6FNXa4TmUS3F0t0Cu03CSAtRD-D225n6vdU3DP8OWA4m-zEI-dQxcI_bUCbYW7gkDiLLO7QRNfjVOdEQJDZlpMasXMBzb_5NP9bbEGtNx30w_7j8PkSjoTiZPsTu4Jq8fGZXmOgLeIbqaFvq3Z_lg |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Apatent&rft.title=Cross-modality+image+generation&rft.inventor=Bongio+Karrman%2C+Anton&rft.inventor=Fan%2C+Ryan+C&rft.date=2022-06-07&rft.externalDBID=B2&rft.externalDocID=US11354772B2 |