Fresh-Priority Eviction for Cuckoo Filters: Exploiting Latent Randomness Under XOR Hashing
Min Liu
Abstract
Cuckoo filters are a widely adopted approximate membership query (AMQ) data structure that supports insertions, lookups, and deletions with low memory overhead. At high load factors, however, insertion performance degrades sharply due to the random-walk eviction process, which may require a large number of element relocations. Recent work on bucketized cuckoo hash tables has shown that fresh-priority eviction, which preferentially evicts elements whose alternate bucket location has not yet been used, achieves O( m) total expected evictions for bucket size~, an improvement over the standard random walk. In this paper, we show that this technique transfers to cuckoo filters despite their use of XOR-based partial-key hashing. The key insight is that a fresh element's fingerprint, although stored in the table, is not examined by the eviction policy, so when the fingerprint length satisfies k = Ω( m), the alternate bucket hash remains a near-uniform random variable, a property we call latent randomness. We prove that under this condition the corruption graph remains subcritical and the total number of evictions is O( m m); we conjecture the tighter O( m) bound holds via the full amortized analysis of Bell and Kuszmaul. We further propose encoding the fresh/kicked state implicitly by the element's position within its bucket, requiring no additional per-element metadata. Experimental results on a filter with 222 slots and 8-bit fingerprints demonstrate 1.2× to 2.4× fewer evictions at load factors between 94\% and 99\% for bucket size = 8, and a 1.73× reduction in cumulative evictions to full capacity.
Create a lesson
Related papers
State Evolution and Universality of Iterated Linear Programs for the Binary Perceptron
Jianan Zhang, Shuangping Li
Metric TSP in Sublinear Time: Breaking Two Approximation
Amir Azarmehr, Soheil Behnezhad
Testing Implies Distance Estimation with Polynomial Loss
Gaia Carenini, Cameron Seth
Online Metric Matching with Unknown i.i.d. Arrivals
Tsubasa Harada
Incremental Open Addressing Has No Time-Space Tradeoff
Martín Farach-Colton, Andrew Krapivin, William Kuszmaul
A Constant-Factor Approximation for Capacitated Facility Location with Outliers
Rajni Dabas