Best of Both Worlds: Multimodal Contrastive Learning with Tabular and Imaging Data

• Published in: Proceedings (IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Online) pp. 23924 - 23935
• Main Authors: Hager, Paul, Menten, Martin J., Rueckert, Daniel
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.06.2023
• Subjects: cell microscopy; Clinical diagnosis; Computer vision; Costs; Deep learning; Medical and biological vision; Myocardium; Pattern recognition; Shape

Medical datasets and especially biobanks, often contain extensive tabular data with rich clinical information in addition to images. In practice, clinicians typically have less data, both in terms of diversity and scale, but still wish to deploy deep learning solutions. Combined with increasing medi...