Anatomy-Guided Weakly-Supervised Abnormality Localization in Chest X-rays
Creating a large-scale dataset of abnormality annotation on medical images is a labor-intensive and costly task. Leveraging weak supervision from readily available data such as radiology reports can compensate lack of large-scale data for anomaly detection methods. However, most of the current metho...
Saved in:
Main Authors | , , , , |
---|---|
Format | Journal Article |
Language | English |
Published |
25.06.2022
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Abstract | Creating a large-scale dataset of abnormality annotation on medical images is
a labor-intensive and costly task. Leveraging weak supervision from readily
available data such as radiology reports can compensate lack of large-scale
data for anomaly detection methods. However, most of the current methods only
use image-level pathological observations, failing to utilize the relevant
anatomy mentions in reports. Furthermore, Natural Language Processing
(NLP)-mined weak labels are noisy due to label sparsity and linguistic
ambiguity. We propose an Anatomy-Guided chest X-ray Network (AGXNet) to address
these issues of weak annotation. Our framework consists of a cascade of two
networks, one responsible for identifying anatomical abnormalities and the
second responsible for pathological observations. The critical component in our
framework is an anatomy-guided attention module that aids the downstream
observation network in focusing on the relevant anatomical regions generated by
the anatomy network. We use Positive Unlabeled (PU) learning to account for the
fact that lack of mention does not necessarily mean a negative label. Our
quantitative and qualitative results on the MIMIC-CXR dataset demonstrate the
effectiveness of AGXNet in disease and anatomical abnormality localization.
Experiments on the NIH Chest X-ray dataset show that the learned feature
representations are transferable and can achieve the state-of-the-art
performances in disease classification and competitive disease localization
results. Our code is available at https://github.com/batmanlab/AGXNet |
---|---|
AbstractList | Creating a large-scale dataset of abnormality annotation on medical images is
a labor-intensive and costly task. Leveraging weak supervision from readily
available data such as radiology reports can compensate lack of large-scale
data for anomaly detection methods. However, most of the current methods only
use image-level pathological observations, failing to utilize the relevant
anatomy mentions in reports. Furthermore, Natural Language Processing
(NLP)-mined weak labels are noisy due to label sparsity and linguistic
ambiguity. We propose an Anatomy-Guided chest X-ray Network (AGXNet) to address
these issues of weak annotation. Our framework consists of a cascade of two
networks, one responsible for identifying anatomical abnormalities and the
second responsible for pathological observations. The critical component in our
framework is an anatomy-guided attention module that aids the downstream
observation network in focusing on the relevant anatomical regions generated by
the anatomy network. We use Positive Unlabeled (PU) learning to account for the
fact that lack of mention does not necessarily mean a negative label. Our
quantitative and qualitative results on the MIMIC-CXR dataset demonstrate the
effectiveness of AGXNet in disease and anatomical abnormality localization.
Experiments on the NIH Chest X-ray dataset show that the learned feature
representations are transferable and can achieve the state-of-the-art
performances in disease classification and competitive disease localization
results. Our code is available at https://github.com/batmanlab/AGXNet |
Author | Liu, Zhexiong Deible, Christopher Ghosh, Shantanu Yu, Ke Batmanghelich, Kayhan |
Author_xml | – sequence: 1 givenname: Ke surname: Yu fullname: Yu, Ke – sequence: 2 givenname: Shantanu surname: Ghosh fullname: Ghosh, Shantanu – sequence: 3 givenname: Zhexiong surname: Liu fullname: Liu, Zhexiong – sequence: 4 givenname: Christopher surname: Deible fullname: Deible, Christopher – sequence: 5 givenname: Kayhan surname: Batmanghelich fullname: Batmanghelich, Kayhan |
BackLink | https://doi.org/10.48550/arXiv.2206.12704$$DView paper in arXiv |
BookMark | eNotj8tOg0AYhWehC60-QFfOCwzOFYYlIVqbkLiwid2Rv8NPnAhDM9BGfHqxujqXnJzkuyVXYQhIyFrwRFtj-CPEL39OpORpImTG9Q3ZFgGmoZ_Z5uQbbOg7wmc3s7fTEePZj0tTHMIQe-j8NNNqcIv5hskPgfpAyw8cJ7pnEebxjly30I14_68rsnt-2pUvrHrdbMuiYpBmmmmpjMmNtqigQeOynGcorVXWoVZtnqPUThgnUmisVEtIM9OmdtlwIQ65WpGHv9sLS32Mvoc4179M9YVJ_QBzdEfX |
ContentType | Journal Article |
Copyright | http://creativecommons.org/licenses/by-sa/4.0 |
Copyright_xml | – notice: http://creativecommons.org/licenses/by-sa/4.0 |
DBID | AKY GOX |
DOI | 10.48550/arxiv.2206.12704 |
DatabaseName | arXiv Computer Science arXiv.org |
DatabaseTitleList | |
Database_xml | – sequence: 1 dbid: GOX name: arXiv.org url: http://arxiv.org/find sourceTypes: Open Access Repository |
DeliveryMethod | fulltext_linktorsrc |
ExternalDocumentID | 2206_12704 |
GroupedDBID | AKY GOX |
ID | FETCH-LOGICAL-a674-423559548e3ade5c7907e28838ce43f99e24c15c16ad82324c675f68e28011b93 |
IEDL.DBID | GOX |
IngestDate | Mon Jan 08 05:48:37 EST 2024 |
IsDoiOpenAccess | true |
IsOpenAccess | true |
IsPeerReviewed | false |
IsScholarly | false |
Language | English |
LinkModel | DirectLink |
MergedId | FETCHMERGED-LOGICAL-a674-423559548e3ade5c7907e28838ce43f99e24c15c16ad82324c675f68e28011b93 |
OpenAccessLink | https://arxiv.org/abs/2206.12704 |
ParticipantIDs | arxiv_primary_2206_12704 |
PublicationCentury | 2000 |
PublicationDate | 2022-06-25 |
PublicationDateYYYYMMDD | 2022-06-25 |
PublicationDate_xml | – month: 06 year: 2022 text: 2022-06-25 day: 25 |
PublicationDecade | 2020 |
PublicationYear | 2022 |
Score | 1.8525714 |
SecondaryResourceType | preprint |
Snippet | Creating a large-scale dataset of abnormality annotation on medical images is
a labor-intensive and costly task. Leveraging weak supervision from readily... |
SourceID | arxiv |
SourceType | Open Access Repository |
SubjectTerms | Computer Science - Computer Vision and Pattern Recognition Computer Science - Learning |
Title | Anatomy-Guided Weakly-Supervised Abnormality Localization in Chest X-rays |
URI | https://arxiv.org/abs/2206.12704 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwdZ07T8MwEIBPpRMLAgEqT3lgNSSO7SRjVdEWxGOgiGyV7ZylCghVH4j-e85JECys9i0-63Tf6V4AF0lGbsYry1Wcai5NZHlekuHlRCcedeptPa7p_kGPn-VtoYoOsJ9eGLP4mn0284Ht8kqISF-G3Kjcgi0hQsnW6LFokpP1KK5W_leOGLM--uMkhruw09Id6zffsQcdrPbhpl9RZPu-4aP1rMSSvaB5fdvwp_U82OmSTvq2CugYiJjdBefSNkeyWcUGYaEVK_jCbJYHMBleTwZj3m4w4EankhOqELBTTICJKVG5lCJRDOt9M4cy8XmOQrpYuVibMgto4wjfvc5IhszO5skhdKuPCnvAjEKpSo0-tlI66zPtIm-l9saa2OTqCHr1u6fzZkjFNKhkWqvk-P-rE9gWoZw_0lyoU-iuFms8Iye7sue1pr8BhSx8BQ |
link.rule.ids | 228,230,786,891 |
linkProvider | Cornell University |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Anatomy-Guided+Weakly-Supervised+Abnormality+Localization+in+Chest+X-rays&rft.au=Yu%2C+Ke&rft.au=Ghosh%2C+Shantanu&rft.au=Liu%2C+Zhexiong&rft.au=Deible%2C+Christopher&rft.date=2022-06-25&rft_id=info:doi/10.48550%2Farxiv.2206.12704&rft.externalDocID=2206_12704 |