Analysis of ENF Signal Extraction From Videos Acquired by Rolling Shutters

• Published in: IEEE transactions on information forensics and security Vol. 18; pp. 4229 - 4242
• Main Authors: Choi, Jisoo, Wong, Chau-Wai, Su, Hui, Wu, Min
• Format: Journal Article
• Language: English
• Published: New York IEEE 2023; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Cameras; Distortion; Electric network frequency (ENF); Electrical networks; filter bank; Forensic computing; Frequency analysis; Inserts; Multimedia; multimedia forensics; multirate signal processing; rolling shutter; Shutters; Signal processing; Signal quality; Time-frequency analysis; Video; Visual signals; Visualization
• ISSN: 1556-6013; 1556-6021
• DOI: 10.1109/TIFS.2023.3287132

Electric network frequency (ENF) analysis is a promising forensic technique for authenticating multimedia recordings and detecting tampering. The validity of the ENF analysis heavily relies on the capability of extracting high-quality ENF signals from multimedia recordings. This paper analyzes and compares two representative methods for extracting ENF signals from visual signals acquired by cameras using the rolling-shutter mechanism. The first method proposed in prior work, direct concatenation , ignores the idle period of each frame. The second method proposed in this paper, periodic zeroing-out , inserts zeros to missing sample points instead of ignoring the idle period. Our theoretical analyses of using multirate signal processing reveal and experiments confirm that while the first method can extract ENF signals without knowing the exact value of camera read-out time, there exists some mild distortion to extracted ENF signals. In contrast, the second method taking the read-out time as the additional input is capable of extracting distortion-free ENF signals, and its frequency component of the highest strength is always located at the nominal frequency. Additionally, we examine aliased DC and negative ENF components caused by the two methods and show that their impact on the accuracy of frequency estimation is minimum. This paper facilitates the fundamental understanding of extracting ENF signals from videos. The research findings imply that the periodic zeroing-out method offers more accurate frequency estimates, but the performance improvement is moderate.