Dynamic Addition of Noise in a Diffusion Model for Anomaly Detection
Diffusion models have found valuable applications in anomaly detection by capturing the nominal data distribution and identifying anomalies via reconstruction. Despite their merits, they struggle to localize anomalies of varying scales, especially larger anomalies such as entire missing components....
Saved in:
Main Authors | , |
---|---|
Format | Journal Article |
Language | English |
Published |
09.01.2024
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Abstract | Diffusion models have found valuable applications in anomaly detection by
capturing the nominal data distribution and identifying anomalies via
reconstruction. Despite their merits, they struggle to localize anomalies of
varying scales, especially larger anomalies such as entire missing components.
Addressing this, we present a novel framework that enhances the capability of
diffusion models, by extending the previous introduced implicit conditioning
approach Meng et al. (2022) in three significant ways. First, we incorporate a
dynamic step size computation that allows for variable noising steps in the
forward process guided by an initial anomaly prediction. Second, we demonstrate
that denoising an only scaled input, without any added noise, outperforms
conventional denoising process. Third, we project images in a latent space to
abstract away from fine details that interfere with reconstruction of large
missing components. Additionally, we propose a fine-tuning mechanism that
facilitates the model to effectively grasp the nuances of the target domain.
Our method undergoes rigorous evaluation on prominent anomaly detection
datasets VisA, BTAD and MVTec yielding strong performance. Importantly, our
framework effectively localizes anomalies regardless of their scale, marking a
pivotal advancement in diffusion-based anomaly detection. |
---|---|
AbstractList | Diffusion models have found valuable applications in anomaly detection by
capturing the nominal data distribution and identifying anomalies via
reconstruction. Despite their merits, they struggle to localize anomalies of
varying scales, especially larger anomalies such as entire missing components.
Addressing this, we present a novel framework that enhances the capability of
diffusion models, by extending the previous introduced implicit conditioning
approach Meng et al. (2022) in three significant ways. First, we incorporate a
dynamic step size computation that allows for variable noising steps in the
forward process guided by an initial anomaly prediction. Second, we demonstrate
that denoising an only scaled input, without any added noise, outperforms
conventional denoising process. Third, we project images in a latent space to
abstract away from fine details that interfere with reconstruction of large
missing components. Additionally, we propose a fine-tuning mechanism that
facilitates the model to effectively grasp the nuances of the target domain.
Our method undergoes rigorous evaluation on prominent anomaly detection
datasets VisA, BTAD and MVTec yielding strong performance. Importantly, our
framework effectively localizes anomalies regardless of their scale, marking a
pivotal advancement in diffusion-based anomaly detection. |
Author | Tayyub, Jawad Tebbe, Justin |
Author_xml | – sequence: 1 givenname: Justin surname: Tebbe fullname: Tebbe, Justin – sequence: 2 givenname: Jawad surname: Tayyub fullname: Tayyub, Jawad |
BackLink | https://doi.org/10.48550/arXiv.2401.04463$$DView paper in arXiv |
BookMark | eNrjYmDJy89LZWCQNDTQM7EwNTXQTyyqyCzTMzIxMNQzMDExM-ZkcHGpzEvMzUxWcExJySzJzM9TyE9T8MvPLE5VyMxTSFRwyUxLKy0Gifvmp6TmKKTlFyk45uXnJuZUKriklqQmg_TwMLCmJeYUp_JCaW4GeTfXEGcPXbB98QVFmbmJRZXxIHvjwfYaE1YBAMNgOQk |
ContentType | Journal Article |
Copyright | http://arxiv.org/licenses/nonexclusive-distrib/1.0 |
Copyright_xml | – notice: http://arxiv.org/licenses/nonexclusive-distrib/1.0 |
DBID | AKY GOX |
DOI | 10.48550/arxiv.2401.04463 |
DatabaseName | arXiv Computer Science arXiv.org |
DatabaseTitleList | |
Database_xml | – sequence: 1 dbid: GOX name: arXiv.org url: http://arxiv.org/find sourceTypes: Open Access Repository |
DeliveryMethod | fulltext_linktorsrc |
ExternalDocumentID | 2401_04463 |
GroupedDBID | AKY GOX |
ID | FETCH-arxiv_primary_2401_044633 |
IEDL.DBID | GOX |
IngestDate | Wed Jun 26 17:19:49 EDT 2024 |
IsDoiOpenAccess | true |
IsOpenAccess | true |
IsPeerReviewed | false |
IsScholarly | false |
Language | English |
LinkModel | DirectLink |
MergedId | FETCHMERGED-arxiv_primary_2401_044633 |
OpenAccessLink | https://arxiv.org/abs/2401.04463 |
ParticipantIDs | arxiv_primary_2401_04463 |
PublicationCentury | 2000 |
PublicationDate | 2024-01-09 |
PublicationDateYYYYMMDD | 2024-01-09 |
PublicationDate_xml | – month: 01 year: 2024 text: 2024-01-09 day: 09 |
PublicationDecade | 2020 |
PublicationYear | 2024 |
Score | 3.823132 |
SecondaryResourceType | preprint |
Snippet | Diffusion models have found valuable applications in anomaly detection by
capturing the nominal data distribution and identifying anomalies via
reconstruction.... |
SourceID | arxiv |
SourceType | Open Access Repository |
SubjectTerms | Computer Science - Computer Vision and Pattern Recognition |
Title | Dynamic Addition of Noise in a Diffusion Model for Anomaly Detection |
URI | https://arxiv.org/abs/2401.04463 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwdV07T8MwED61nVgQCFB538AaSB3XScaKUCokygJStsixfVKkkqI2RfDv8aMIlq72yT75ZH33PoAbzdU4ptpEWqVJxEnYP8eJRUqIPJNSkTaudvh5LmZv_Kkclz3A31oYufpqPkN_4Hp9Z-FmdOtCjkkf-oy5lK3HlzIEJ30rri39H53VMf3SP5CYHsD-VrvDSRDHIfRMewRFEaa-40RrnyCFS8L5slkbbFqUWDREG-e0QjeYbIFWjURrlb_LxTcWpvO5Uu0xXE8fXu9nkb-3-ghNIirHUuVZSk5gYE15MwSMeaoFJSpxJalplsssrsmkNIq1ZjlTpzDcdcrZ7q1z2GMWar1jIL-AQbfamEsLlV195d_rBwaLbZo |
link.rule.ids | 228,230,783,888 |
linkProvider | Cornell University |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Dynamic+Addition+of+Noise+in+a+Diffusion+Model+for+Anomaly+Detection&rft.au=Tebbe%2C+Justin&rft.au=Tayyub%2C+Jawad&rft.date=2024-01-09&rft_id=info:doi/10.48550%2Farxiv.2401.04463&rft.externalDocID=2401_04463 |