Papers › EQ-CBM: A Probabilistic Concept Bottleneck with Energy-based Models and Quantized Vectors

EQ-CBM: A Probabilistic Concept Bottleneck with Energy-based Models and Quantized Vectors

22 Sep 2024arXiv:2409.14630archive 2025-07-28

Sangwon Kim, Dasom Ahn, Byoung Chul Ko, In-Su Jang, Kwang-Ju Kim

The demand for reliable AI systems has intensified the need for interpretable deep neural networks. Concept bottleneck models (CBMs) have gained attention as an effective approach by leveraging human-understandable concepts to enhance interpretability. However, existing CBMs face challenges due to deterministic concept encoding and reliance on inconsistent concepts, leading to inaccuracies. We propose EQ-CBM, a novel framework that enhances CBMs through probabilistic concept encoding using energy-based models (EBMs) with quantized concept activation vectors (qCAVs). EQ-CBM effectively captures uncertainties, thereby improving prediction reliability and accuracy. By employing qCAVs, our method selects homogeneous vectors during concept encoding, enabling more decisive task performance and facilitating higher levels of human intervention. Empirical results using benchmark datasets demonstrate that our approach outperforms the state-of-the-art in both concept and task accuracy.

PaperPDFConference PDF

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Concept-based Classification AwA2 EQ-CBM (ResNet-34) Concept Accuracy (%) 99.129 #1 of 2 Archive leaderboard report
Concept-based Classification AwA2 EQ-CBM (ResNet-34) Task Accuracy (%) 95.965 #1 of 2 Archive leaderboard report
Concept-based Classification CUB-200-2011 EQ-CBM (ResNet-34) Concept Accuracy (%) 96.580 #2 of 2 Archive leaderboard report
Concept-based Classification CUB-200-2011 EQ-CBM (ResNet-34) Task Accuracy (%) 79.310 #2 of 2 Archive leaderboard report
Concept-based Classification CelebA EQ-CBM (ResNet-34) Concept Accuracy (%) 90.617 #1 of 2 Archive leaderboard report
Concept-based Classification CelebA EQ-CBM (ResNet-34) Task Accuracy (%) 56.600 #1 of 2 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

AttentionSoftmax

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections