Papers › Random feature-based double Vovk-Azoury-Warmuth algorithm for online multi-kernel learning

Random feature-based double Vovk-Azoury-Warmuth algorithm for online multi-kernel learning

25 Mar 2025arXiv:2503.20087archive 2025-07-28

Dmitry B. Rokhlin, Olga V. Gurtovaya

We introduce a novel multi-kernel learning algorithm, VAW², for online least squares regression in reproducing kernel Hilbert spaces (RKHS). VAW² leverages random Fourier feature-based functional approximation and the Vovk-Azoury-Warmuth (VAW) method in a two-level procedure: VAW is used to construct expert strategies from random features generated for each kernel at the first level, and then again to combine their predictions at the second level. A theoretical analysis yields a regret bound of O(T^(1/2)lnT) in expectation with respect to artificial randomness, when the number of random features scales as T^(1/2). Empirical results on some benchmark datasets demonstrate that VAW² achieves superior performance compared to the existing online multi-kernel learning algorithms: Raker and OMKL-GF, and to other theoretically grounded method methods involving convex combination of expert predictions at the second level.

PaperPDFCode

Code

O-Gurt/VAW2 official report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections