Machine Learning Based Single-Frame Super-Resolution Processing for Lensless Blood Cell Counting

• Published in: Sensors (Basel, Switzerland) Vol. 16; no. 11; p. 1836
• Main Authors: Huang, Xiwei, Jiang, Yu, Liu, Xu, Xu, Hang, Han, Zhi, Rong, Hailong, Yang, Haiping, Yan, Mei, Yu, Hao
• Format: Journal Article
• Language: English
• Published: Switzerland MDPI AG 02.11.2016; MDPI
• Subjects: Artificial intelligence; Blood; Blood Cell Count - methods; Blood cells; CMOS; CMOS image sensor; convolutional neural network; Customization; Digital cameras; extreme learning machine; Flow Cytometry; Humans; Machine Learning; Metal oxide semiconductors; Microfluidic Analytical Techniques; microfluidic cytometer; point-of-care testing; Resolution cell; Semiconductors; Sensors; super-resolution; point-of-care testing; CMOS image sensor; convolutional neural network; extreme learning machine; super-resolution; microfluidic cytometer
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s16111836

A lensless blood cell counting system integrating microfluidic channel and a complementary metal oxide semiconductor (CMOS) image sensor is a promising technique to miniaturize the conventional optical lens based imaging system for point-of-care testing (POCT). However, such a system has limited resolution, making it imperative to improve resolution from the system-level using super-resolution (SR) processing. Yet, how to improve resolution towards better cell detection and recognition with low cost of processing resources and without degrading system throughput is still a challenge. In this article, two machine learning based single-frame SR processing types are proposed and compared for lensless blood cell counting, namely the Extreme Learning Machine based SR (ELMSR) and Convolutional Neural Network based SR (CNNSR). Moreover, lensless blood cell counting prototypes using commercial CMOS image sensors and custom designed backside-illuminated CMOS image sensors are demonstrated with ELMSR and CNNSR. When one captured low-resolution lensless cell image is input, an improved high-resolution cell image will be output. The experimental results show that the cell resolution is improved by 4×, and CNNSR has 9.5% improvement over the ELMSR on resolution enhancing performance. The cell counting results also match well with a commercial flow cytometer. Such ELMSR and CNNSR therefore have the potential for efficient resolution improvement in lensless blood cell counting systems towards POCT applications.