Dominant Graph: An Efficient Indexing Structure to Answer Top-K Queries

• Published in: 2008 IEEE 24th International Conference on Data Engineering pp. 536 - 545
• Main Authors: Lei Zou, Lei Chen
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.04.2008
• Subjects: Aggregates; Cost function; Indexing; Nearest neighbor searches; Remuneration; Space exploration
• ISBN: 9781424418367; 1424418364
• ISSN: 1063-6382; 2375-026X
• DOI: 10.1109/ICDE.2008.4497462

Given a record set D and a query score function F, a top-k query returns k records from D, whose values of function F on their attributes are the highest. In this paper, we investigate the intrinsic connection between top-k queries and dominant relationship between records, and based on which, we propose an efficient layer-based indexing structure, Dominant Graph (DG), to improve the query efficiency. Specifically, DG is built offline to express the dominant relationship between records and top-k query is implemented as a graph traversal problem, i.e. Traveler algorithm. We prove theoretically that the size of search space (that is the number of retrieved records from the record set to answer top-k query) in our basic algorithm is directly related to the cardinality of skyline points in the record set (see Theorem 3.2). Based on the cost analysis, we propose the optimization technique, pseudo record, to improve the search efficiency. In order to handle the top-k query in the high dimension record set, we also propose N-Way Traveler algorithm. Finally, extensive experiments demonstrate that our proposed methods have significant improvement over its counterparts, including both classical and state art of top-k algorithms. For example, the search space in our algorithm is less than 1/5 of that in AppRI (Xin et al., 2006), one of state art of top-k algorithms. Furthermore, our method can support any aggregate monotone query function.