Real-Time Semantic Background Subtraction

Semantic background subtraction SBS has been shown to improve the performance of most background subtraction algorithms by combining them with semantic information, derived from a semantic segmentation network. However, SBS requires high-quality semantic segmentation masks for all frames, which are...

Full description

Saved in:
Bibliographic Details
Published inarXiv.org
Main Authors Cioppa, Anthony, Marc Van Droogenbroeck, Braham, Marc
Format Paper
LanguageEnglish
Published Ithaca Cornell University Library, arXiv.org 27.05.2020
Subjects
Algorithms
Masks
Performance enhancement
Real time
Semantic segmentation
Semantics
Subtraction
Online AccessGet full text

Cover

More Information
Summary:Semantic background subtraction SBS has been shown to improve the performance of most background subtraction algorithms by combining them with semantic information, derived from a semantic segmentation network. However, SBS requires high-quality semantic segmentation masks for all frames, which are slow to compute. In addition, most state-of-the-art background subtraction algorithms are not real-time, which makes them unsuitable for real-world applications. In this paper, we present a novel background subtraction algorithm called Real-Time Semantic Background Subtraction (denoted RT-SBS) which extends SBS for real-time constrained applications while keeping similar performances. RT-SBS effectively combines a real-time background subtraction algorithm with high-quality semantic information which can be provided at a slower pace, independently for each pixel. We show that RT-SBS coupled with ViBe sets a new state of the art for real-time background subtraction algorithms and even competes with the non real-time state-of-the-art ones. Note that we provide python CPU and GPU implementations of RT-SBS at https://github.com/cioppaanthony/rt-sbs.
ISSN:2331-8422