Papers › IsoQuant: Hardware-Aligned SO(4) Isoclinic Rotations for LLM KV Cache Compression
IsoQuant: Hardware-Aligned SO(4) Isoclinic Rotations for LLM KV Cache Compression
Zhongping Ji
Title, abstract, authors and date from arXiv's metadata (CC0); this paper is not in the Papers with Code archive (frozen 2025-07-28).
Orthogonal feature decorrelation is effective for low-bit online vector quantization, but dense random orthogonal transforms incur prohibitive O(d²) storage and compute. RotorQuant reduces this cost with blockwise $3$D Clifford rotors, yet the resulting $3$D partition is poorly aligned with modern hardware and offers limited local mixing. We propose \textbf{IsoQuant}, a blockwise rotation framework based on quaternion algebra and the isoclinic decomposition of SO(4). It represents each $4$D block as a quaternion and applies a closed-form transform T(v)=q_L v q_R. This yields two main variants: \emph{IsoQuant-Full}, which realizes the full SO(4) rotation, and \emph{IsoQuant-Fast}, which keeps only one isoclinic factor for lower cost; the framework also admits a lightweight $2$D special case. At d=128, IsoQuant-Full reduces forward rotation cost from about 2,408 FMAs in RotorQuant to 1,024, while IsoQuant-Fast further reduces it to $512$. Across $18$ fused CUDA settings with d ∈128,256,512, bit widths 2,3,4, and FP16/FP32 execution, IsoQuant achieves mean kernel-level speedups of about 4.5×--4.7× over RotorQuant while maintaining comparable reconstruction MSE, with peak speedups above 6×. Current validation is limited to the stage-1 quantize--dequantize path on synthetic normalized vectors; end-to-end KV-cache evaluation remains future work.
In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
Code
Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
Code Syntology ran Syntology
Syntology holds the repository link but has not harvested or run code from it.
Results from the paper
The Papers with Code archive ends with its 2025-07-28 snapshot. This paper's arXiv identifier, 2603.28430, was issued in March 2026, after that date, so the archive has no leaderboard rows for it.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections