Papers › Fix Fairness, Don't Ruin Accuracy: Performance Aware Fairness Repair using AutoML

Fix Fairness, Don't Ruin Accuracy: Performance Aware Fairness Repair using AutoML

15 Jun 2023arXiv:2306.09297archive 2025-07-28

Giang Nguyen, Sumon Biswas, Hridesh Rajan

Machine learning (ML) is increasingly being used in critical decision-making software, but incidents have raised questions about the fairness of ML predictions. To address this issue, new tools and methods are needed to mitigate bias in ML-based software. Previous studies have proposed bias mitigation algorithms that only work in specific situations and often result in a loss of accuracy. Our proposed solution is a novel approach that utilizes automated machine learning (AutoML) techniques to mitigate bias. Our approach includes two key innovations: a novel optimization function and a fairness-aware search space. By improving the default optimization function of AutoML and incorporating fairness objectives, we are able to mitigate bias with little to no loss of accuracy. Additionally, we propose a fairness-aware search space pruning method for AutoML to reduce computational cost and repair time. Our approach, built on the state-of-the-art Auto-Sklearn tool, is designed to reduce bias in real-world scenarios. In order to demonstrate the effectiveness of our approach, we evaluated our approach on four fairness problems and 16 different ML models, and our results show a significant improvement over the baseline and existing bias mitigation techniques. Our approach, Fair-AutoML, successfully repaired 60 out of 64 buggy cases, while existing bias mitigation techniques only repaired up to 44 out of 64 cases.

PaperPDFCode

Code

giangnm58/fair-automl officialmentioned in papermentioned on GitHub report
tess022095/fair-automl officialmentioned in papermentioned on GitHub report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

AutoMLDecision MakingFairness

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

PruningRepair

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections