A new key frame representation for video segment retrieval

• Published in: IEEE transactions on circuits and systems for video technology Vol. 15; no. 9; pp. 1148 - 1155
• Main Authors: SZE, Kin-Wai, LAM, Kin-Man, GUOPING QIU
• Format: Journal Article
• Language: English
• Published: New York, NY IEEE 01.09.2005; Institute of Electrical and Electronics Engineers; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Applied sciences; Construction; Content based retrieval; Content-based video retrieval; Exact sciences and technology; Frames; Gunshot detection systems; Histograms; Indexing; Information theory; Information, signal and communications theory; key frame representation; Layout; MPEG 7 Standard; Optimization; Performance evaluation; Pixels; Probability distribution; Representations; Retrieval; Shot; Statistics; Studies; Telecommunications and information theory; video indexing; Video sequences; Performance evaluation; Signal compression; Histogram; Probabilistic approach; Video signal; video indexing; Video technique; Information retrieval; Probability distribution; Frame based representation; Image sequence; Content-based retrieval; Content-based video retrieval; key frame representation; Indexing
• DOI: 10.1109/TCSVT.2005.852623
• ISSN: 1051-8215

In this paper, we propose an optimal key frame representation scheme based on global statistics for video shot retrieval. Each pixel in this optimal key frame is constructed by considering the probability of occurrence of those pixels at the corresponding pixel position among the frames in a video shot. Therefore, this constructed key frame is called temporally maximum occurrence frame (TMOF), which is an optimal representation of all the frames in a video shot. The retrieval performance of this representation scheme is further improved by considering the k pixel values with the largest probabilities of occurrence and the highest peaks of the probability distribution of occurrence at each pixel position for a video shot. The corresponding schemes are called k-TMOF and k-pTMOF, respectively. These key frame representation schemes are compared to other histogram-based techniques for video shot representation and retrieval. In the experiments, three video sequences in the MPEG-7 content set were used to evaluate the performances of the different key frame representation schemes. Experimental results show that our proposed representations outperform the alpha-trimmed average histogram for video retrieval.