Evaluating Opinion Summarization in Ranking

We discuss the evaluation of rankings of documents that aim to summarize the overall opinion expressed in product reviews. Such a ranking can be used by e-commerce websites to represent a gist of the public opinion about a product. The inability of traditional IR metrics to reward such a representat...

Full description

Saved in:
Bibliographic Details
Published inInformation Retrieval Technology Vol. 10648; pp. 222 - 234
Main Authors Singh, Anil Kumar, Thawani, Avijit, Gupta, Anubhav, Mundotiya, Rajesh Kumar
Format Book Chapter
LanguageEnglish
Published Switzerland Springer International Publishing AG 2017
Springer International Publishing
SeriesLecture Notes in Computer Science
Subjects
Diversity
Opinion
Proportionality
Reviews
Summarization
Online AccessGet full text
ISBN3319701444
9783319701448
ISSN0302-9743
1611-3349
DOI10.1007/978-3-319-70145-5_17

Cover

More Information
Summary:We discuss the evaluation of rankings of documents that aim to summarize the overall opinion expressed in product reviews. Such a ranking can be used by e-commerce websites to represent a gist of the public opinion about a product. The inability of traditional IR metrics to reward such a representation is argued for. A matrix based labelling procedure serves as the framework for such evaluation. Three alternative metrics are adapted from previous similar works to evaluate opinion representativeness. Similarly, two metrics are adapted for exhaustiveness. Finally, we compare the robustness of these metrics.
ISBN:3319701444
9783319701448
ISSN:0302-9743
1611-3349
DOI:10.1007/978-3-319-70145-5_17