Combining Relevance Language Modeling and Clarity Measure for Extractive Speech Summarization

• Published in: IEEE/ACM transactions on audio, speech, and language processing Vol. 23; no. 6; pp. 957 - 969
• Main Authors: Shih-Hung Liu, Kuan-Yu Chen, Chen, Berlin, Hsin-Min Wang, Hsu-Chun Yen, Wen-Lian Hsu
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 01.06.2015; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Clarity measure; Context modeling; IEEE transactions; KL divergence; language modeling; relevance modeling; Semantics; Speech; Speech processing; Speech recognition; speech summarization; Vectors
• ISSN: 2329-9290; 2329-9304
• DOI: 10.1109/TASLP.2015.2414820

Extractive speech summarization, which purports to select an indicative set of sentences from a spoken document so as to succinctly represent the most important aspects of the document, has garnered much research over the years. In this paper, we cast extractive speech summarization as an ad-hoc information retrieval (IR) problem and investigate various language modeling (LM) methods for important sentence selection. The main contributions of this paper are four-fold. First, we explore a novel sentence modeling paradigm built on top of the notion of relevance, where the relationship between a candidate summary sentence and a spoken document to be summarized is discovered through different granularities of context for relevance modeling. Second, not only lexical but also topical cues inherent in the spoken document are exploited for sentence modeling. Third, we propose a novel clarity measure for use in important sentence selection, which can help quantify the thematic specificity of each individual sentence that is deemed to be a crucial indicator orthogonal to the relevance measure provided by the LM-based methods. Fourth, in an attempt to lessen summarization performance degradation caused by imperfect speech recognition, we investigate making use of different levels of index features for LM-based sentence modeling, including words, subword-level units, and their combination. Experiments on broadcast news summarization seem to demonstrate the performance merits of our methods when compared to several existing well-developed and/or state-of-the-art methods.