Video from Stills: Lensless Imaging with Rolling Shutter

Because image sensor chips have a finite bandwidth with which to read out pixels, recording video typically requires a trade-off between frame rate and pixel count. Compressed sensing techniques can circumvent this trade-off by assuming that the image is compressible. Here, we propose using multiple...

Full description

Saved in:
Bibliographic Details
Published in2019 IEEE International Conference on Computational Photography (ICCP) pp. 1 - 8
Main Authors Antipa, Nick, Oare, Patrick, Bostan, Emrah, Ng, Ren, Waller, Laura
Format Conference Proceeding
LanguageEnglish
Published IEEE 01.05.2019
Subjects
Bandwidth
Cameras
CMOS image sensors
compressed sensing
Image coding
Image reconstruction
lensless imaging
Multiplexing
optical imaging
Optics
video signal processing
Online AccessGet full text

Cover

More Information
Summary:Because image sensor chips have a finite bandwidth with which to read out pixels, recording video typically requires a trade-off between frame rate and pixel count. Compressed sensing techniques can circumvent this trade-off by assuming that the image is compressible. Here, we propose using multiplexing optics to spatially compress the scene, enabling information about the whole scene to be sampled from a row of sensor pixels, which can be read off quickly via a rolling shutter CMOS sensor. Conveniently, such multiplexing can be achieved with a simple lensless, diffuser-based imaging system. Using sparse recovery methods, we are able to recover 140 video frames at over 4,500 frames per second, all from a single captured image with a rolling shutter sensor. Our proof-of-concept system uses easily-fabricated diffusers paired with an off-the-shelf sensor. The resulting prototype enables compressive encoding of high frame rate video into a single rolling shutter exposure, and exceeds the sampling-limited performance of an equivalent global shutter system for sufficiently sparse objects.
ISSN:2472-7636
DOI:10.1109/ICCPHOT.2019.8747341