Papers › COCO: A Platform for Comparing Continuous Optimizers in a Black-Box Setting

COCO: A Platform for Comparing Continuous Optimizers in a Black-Box Setting

29 Mar 2016arXiv:1603.08785archive 2025-07-28

Nikolaus Hansen, Anne Auger, Raymond Ros, Olaf Mersmann, Tea Tušar, Dimo Brockhoff

We introduce COCO, an open source platform for Comparing Continuous Optimizers in a black-box setting. COCO aims at automatizing the tedious and repetitive task of benchmarking numerical optimization algorithms to the greatest possible extent. The platform and the underlying methodology allow to benchmark in the same framework deterministic and stochastic solvers for both single and multiobjective optimization. We present the rationales behind the (decade-long) development of the platform as a general proposition for guidelines towards better benchmarking. We detail underlying fundamental concepts of COCO such as the definition of a problem as a function instance, the underlying idea of instances, the use of target values, and runtime defined by the number of function calls as the central performance measure. Finally, we give a quick overview of the basic code structure and the currently available test suites.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

numbbo/coco officialmentioned in papermentioned on GitHubNOASSERTION report
JohnYKiyo/coco_trial mentioned on GitHubMIT report
amkall/tcc_coco mentioned on GitHubNOASSERTION report
patsp/coco mentioned on GitHubNOASSERTION report
ryojitanabe/APL mentioned on GitHub report
ryojitanabe/as_bbo mentioned on GitHub report
ryojitanabe/ela_drframework mentioned on GitHub report
ryojitanabe/largebbob2022 mentioned on GitHub report
ryojitanabe/tpb mentioned on GitHubpytorch report
ttusar/coco mentioned on GitHubNOASSERTION report
ttusar/coco-gbea mentioned on GitHubNOASSERTION report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

BenchmarkingMultiobjective Optimization

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections