Text detection in video frames using hybrid features

• Published in: 2009 International Conference on Machine Learning and Cybernetics Vol. 1; pp. 318 - 322
• Main Authors: Zhong Ji, Jian Wang, Yu-Ting Su
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.07.2009
• Subjects: Feature extraction; Image edge detection; Indexing; Layout; Overlay text; Robustness; Scene text; Speech analysis; Support vector machines; SVM; Text detection; Transform coding; Video annotation; Video compression; Videoconference
• DOI: 10.1109/ICMLC.2009.5212547
• ISBN: 9781424437023; 1424437024
• ISSN: 2160-133X

Text in video frames provides brief and important content information which is helpful to video scene understanding, annotation and searching. A new text detection method in video frames is proposed in this paper. First, a small overlapped sliding window is scanned over the frame from which hybrid features are extracted. And then SVM classifier is employed to distinguish the text from background. At last, vote mechanism and morphological filter are performed to precisely locate the text region. The new method is expected to outperform the existing strategies based on the following two improvements. One is selecting robust features to distinguish both the scene and overlay text from the complex backgrounds. The other is addressing the multilingual capability over the whole processing. The proposed algorithm has been evaluated by four different kinds of videos and the experiments show its high performance.