Dynamic Addition of Noise in a Diffusion Model for Anomaly Detection

Diffusion models have found valuable applications in anomaly detection by capturing the nominal data distribution and identifying anomalies via reconstruction. Despite their merits, they struggle to localize anomalies of varying scales, especially larger anomalies such as entire missing components....

Full description

Saved in:
Bibliographic Details
Main Authors Tebbe, Justin, Tayyub, Jawad
Format Journal Article
LanguageEnglish
Published 09.01.2024
Subjects
Online AccessGet full text

Cover

Loading…
Abstract Diffusion models have found valuable applications in anomaly detection by capturing the nominal data distribution and identifying anomalies via reconstruction. Despite their merits, they struggle to localize anomalies of varying scales, especially larger anomalies such as entire missing components. Addressing this, we present a novel framework that enhances the capability of diffusion models, by extending the previous introduced implicit conditioning approach Meng et al. (2022) in three significant ways. First, we incorporate a dynamic step size computation that allows for variable noising steps in the forward process guided by an initial anomaly prediction. Second, we demonstrate that denoising an only scaled input, without any added noise, outperforms conventional denoising process. Third, we project images in a latent space to abstract away from fine details that interfere with reconstruction of large missing components. Additionally, we propose a fine-tuning mechanism that facilitates the model to effectively grasp the nuances of the target domain. Our method undergoes rigorous evaluation on prominent anomaly detection datasets VisA, BTAD and MVTec yielding strong performance. Importantly, our framework effectively localizes anomalies regardless of their scale, marking a pivotal advancement in diffusion-based anomaly detection.
AbstractList Diffusion models have found valuable applications in anomaly detection by capturing the nominal data distribution and identifying anomalies via reconstruction. Despite their merits, they struggle to localize anomalies of varying scales, especially larger anomalies such as entire missing components. Addressing this, we present a novel framework that enhances the capability of diffusion models, by extending the previous introduced implicit conditioning approach Meng et al. (2022) in three significant ways. First, we incorporate a dynamic step size computation that allows for variable noising steps in the forward process guided by an initial anomaly prediction. Second, we demonstrate that denoising an only scaled input, without any added noise, outperforms conventional denoising process. Third, we project images in a latent space to abstract away from fine details that interfere with reconstruction of large missing components. Additionally, we propose a fine-tuning mechanism that facilitates the model to effectively grasp the nuances of the target domain. Our method undergoes rigorous evaluation on prominent anomaly detection datasets VisA, BTAD and MVTec yielding strong performance. Importantly, our framework effectively localizes anomalies regardless of their scale, marking a pivotal advancement in diffusion-based anomaly detection.
Author Tayyub, Jawad
Tebbe, Justin
Author_xml – sequence: 1
  givenname: Justin
  surname: Tebbe
  fullname: Tebbe, Justin
– sequence: 2
  givenname: Jawad
  surname: Tayyub
  fullname: Tayyub, Jawad
BackLink https://doi.org/10.48550/arXiv.2401.04463$$DView paper in arXiv
BookMark eNrjYmDJy89LZWCQNDTQM7EwNTXQTyyqyCzTMzIxMNQzMDExM-ZkcHGpzEvMzUxWcExJySzJzM9TyE9T8MvPLE5VyMxTSFRwyUxLKy0Gifvmp6TmKKTlFyk45uXnJuZUKriklqQmg_TwMLCmJeYUp_JCaW4GeTfXEGcPXbB98QVFmbmJRZXxIHvjwfYaE1YBAMNgOQk
ContentType Journal Article
Copyright http://arxiv.org/licenses/nonexclusive-distrib/1.0
Copyright_xml – notice: http://arxiv.org/licenses/nonexclusive-distrib/1.0
DBID AKY
GOX
DOI 10.48550/arxiv.2401.04463
DatabaseName arXiv Computer Science
arXiv.org
DatabaseTitleList
Database_xml – sequence: 1
  dbid: GOX
  name: arXiv.org
  url: http://arxiv.org/find
  sourceTypes: Open Access Repository
DeliveryMethod fulltext_linktorsrc
ExternalDocumentID 2401_04463
GroupedDBID AKY
GOX
ID FETCH-arxiv_primary_2401_044633
IEDL.DBID GOX
IngestDate Wed Jun 26 17:19:49 EDT 2024
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed false
IsScholarly false
Language English
LinkModel DirectLink
MergedId FETCHMERGED-arxiv_primary_2401_044633
OpenAccessLink https://arxiv.org/abs/2401.04463
ParticipantIDs arxiv_primary_2401_04463
PublicationCentury 2000
PublicationDate 2024-01-09
PublicationDateYYYYMMDD 2024-01-09
PublicationDate_xml – month: 01
  year: 2024
  text: 2024-01-09
  day: 09
PublicationDecade 2020
PublicationYear 2024
Score 3.823132
SecondaryResourceType preprint
Snippet Diffusion models have found valuable applications in anomaly detection by capturing the nominal data distribution and identifying anomalies via reconstruction....
SourceID arxiv
SourceType Open Access Repository
SubjectTerms Computer Science - Computer Vision and Pattern Recognition
Title Dynamic Addition of Noise in a Diffusion Model for Anomaly Detection
URI https://arxiv.org/abs/2401.04463
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwdV07T8MwED61nVgQCFB538AaSB3XScaKUCokygJStsixfVKkkqI2RfDv8aMIlq72yT75ZH33PoAbzdU4ptpEWqVJxEnYP8eJRUqIPJNSkTaudvh5LmZv_Kkclz3A31oYufpqPkN_4Hp9Z-FmdOtCjkkf-oy5lK3HlzIEJ30rri39H53VMf3SP5CYHsD-VrvDSRDHIfRMewRFEaa-40RrnyCFS8L5slkbbFqUWDREG-e0QjeYbIFWjURrlb_LxTcWpvO5Uu0xXE8fXu9nkb-3-ghNIirHUuVZSk5gYE15MwSMeaoFJSpxJalplsssrsmkNIq1ZjlTpzDcdcrZ7q1z2GMWar1jIL-AQbfamEsLlV195d_rBwaLbZo
link.rule.ids 228,230,783,888
linkProvider Cornell University
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Dynamic+Addition+of+Noise+in+a+Diffusion+Model+for+Anomaly+Detection&rft.au=Tebbe%2C+Justin&rft.au=Tayyub%2C+Jawad&rft.date=2024-01-09&rft_id=info:doi/10.48550%2Farxiv.2401.04463&rft.externalDocID=2401_04463