Fast Loads and Queries

For efficient query processing, a relational table should be indexed in multiple ways; for efficient database loading, indexes should be omitted. This research introduces new techniques called zones filters, zone indexes, adaptive merging, and partition filters. The new data structures can be create...

Full description

Saved in:
Bibliographic Details
Published inTransactions on Large-Scale Data- and Knowledge-Centered Systems II pp. 31 - 72
Main Authors Graefe, Goetz, Kuno, Harumi
Format Book Chapter
LanguageEnglish
Published Berlin, Heidelberg Springer Berlin Heidelberg 2010
SeriesLecture Notes in Computer Science
Subjects
Online AccessGet full text

Cover

Loading…
More Information
Summary:For efficient query processing, a relational table should be indexed in multiple ways; for efficient database loading, indexes should be omitted. This research introduces new techniques called zones filters, zone indexes, adaptive merging, and partition filters. The new data structures can be created as side effects of the load process, with all required analyses accomplished while a moderate amount of new data still remains in the buffer pool. Traditional sorting and indexing are not required. Nonetheless, query performance matches that of Netezza’s zone maps where those apply, exceeds it for the many predicates for which zone maps are ineffective, and can be comparable to query processing with traditional indexing, as demonstrated in our simulations.
ISBN:9783642161742
364216174X
ISSN:0302-9743
1611-3349
DOI:10.1007/978-3-642-16175-9_2