Papers › HyperMinHash: MinHash in LogLog space

HyperMinHash: MinHash in LogLog space

23 Oct 2017arXiv:1710.08436links table onlyarchive 2025-07-28

Yun William Yu, Griffin M. Weber

The archive published only this paper's code-link row. Authors, date and abstract are from arXiv's metadata (CC0), read from the Kaggle arXiv metadata snapshot of 2026-09-12 where its title matched the archive's; the title is the archive's.

In this extended abstract, we describe and analyze a lossy compression of MinHash from buckets of size O(logn) to buckets of size O(loglogn) by encoding using floating-point notation. This new compressed sketch, which we call HyperMinHash, as we build off a HyperLogLog scaffold, can be used as a drop-in replacement of MinHash. Unlike comparable Jaccard index fingerprinting algorithms in sub-logarithmic space (such as b-bit MinHash), HyperMinHash retains MinHash's features of streaming updates, unions, and cardinality estimation. For a multiplicative approximation error 1+ ϵ on a Jaccard index $ t $, given a random oracle, HyperMinHash needs O(ϵ⁻² ( loglogn + log1/(t ϵ) )) space. HyperMinHash allows estimating Jaccard indices of 0.01 for set cardinalities on the order of 10¹⁹ with relative error of around 10\% using 64KiB of memory; MinHash can only estimate Jaccard indices for cardinalities of 10¹⁰ with the same memory consumption.

PaperPDFCode

Code

yunwilliamyu/hyperminhash officialmentioned in papermentioned on GitHub report
LiveRamp/HyperMinHash-java officialmentioned on GitHub report
axiomhq/hyperminhash officialmentioned on GitHub report
scottlittle/drac mentioned on GitHub report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections