CARAMEL: A Succinct Read-Only Lookup Table via Compressed Static Functions

Lookup tables are a fundamental structure in many data processing and systems applications. Examples include tokenized text in NLP, quantized embedding collections in recommendation systems, integer sketches for streaming data, and hash-based string representations in genomics. With the increasing s...

Full description

Saved in:
Bibliographic Details
Published inarXiv.org
Main Authors Coleman, Benjamin, David Torres Ramos, Vihan Lakshman, Chen, Luo, Shrivastava, Anshumali
Format Paper
LanguageEnglish
Published Ithaca Cornell University Library, arXiv.org 26.05.2023
Subjects
Data processing
Data structures
Entropy
Lookup tables
Read only
Recommender systems
Representations
Sketches
Tables (data)
Online AccessGet full text

Cover

More Information
Summary:Lookup tables are a fundamental structure in many data processing and systems applications. Examples include tokenized text in NLP, quantized embedding collections in recommendation systems, integer sketches for streaming data, and hash-based string representations in genomics. With the increasing size of web-scale data, such applications often require compression techniques that support fast random \(O(1)\) lookup of individual parameters directly on the compressed data (i.e. without blockwise decompression in RAM). While the community has proposd a number of succinct data structures that support queries over compressed representations, these approaches do not fully leverage the low-entropy structure prevalent in real-world workloads to reduce space. Inspired by recent advances in static function construction techniques, we propose a space-efficient representation of immutable key-value data, called CARAMEL, specifically designed for the case where the values are multi-sets. By carefully combining multiple compressed static functions, CARAMEL occupies space proportional to the data entropy with low memory overheads and minimal lookup costs. We demonstrate 1.25-16x compression on practical lookup tasks drawn from real-world systems, improving upon established techniques, including a production-grade read-only database widely used for development within Amazon.com.
ISSN:2331-8422