Papers › MMBAttn: Max-Mean and Bit-wise Attention for CTR Prediction
MMBAttn: Max-Mean and Bit-wise Attention for CTR Prediction
Hasan Saribas, Cagri Yesil, Serdarcan Dilbaz, Halit Orenbas
With the increasing complexity and scale of click-through rate (CTR) prediction tasks in online advertising and recommendation systems, accurately estimating the importance of features has become a critical aspect of developing effective models. In this paper, we propose an attention-based approach that leverages max and mean pooling operations, along with a bit-wise attention mechanism, to enhance feature importance estimation in CTR prediction. Traditionally, pooling operations such as max and mean pooling have been widely used to extract relevant information from features. However, these operations can lead to information loss and hinder the accurate determination of feature importance. To address this challenge, we propose a novel attention architecture that utilizes a bit-based attention structure that emphasizes the relationships between all bits in features, together with maximum and mean pooling. By considering the fine-grained interactions at the bit level, our method aims to capture intricate patterns and dependencies that might be overlooked by traditional pooling operations. To examine the effectiveness of the proposed method, experiments have been conducted on three public datasets. The experiments demonstrated that the proposed method significantly improves the performance of the base models to achieve state-of-the-art results.
Code
No code repository is listed for this paper in the archive or in Syntology's graph.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Click-Through Rate Prediction | Avazu | FinalMLP + MMBAttn | AUC | 0.7666 | #12 of 15 | Archive leaderboard | report |
| Click-Through Rate Prediction | Avazu | DNN + MMBAttn | AUC | 0.765 | #13 of 15 | Archive leaderboard | report |
| Click-Through Rate Prediction | Criteo | FinalMLP + MMBAttn | AUC | 0.81497 | #6 of 39 | Archive leaderboard | report |
| Click-Through Rate Prediction | Criteo | DNN + MMBAttn | AUC | 0.8143 | #10 of 39 | Archive leaderboard | report |
| Click-Through Rate Prediction | Frappe | FinalMLP + MMBAttn | AUC | 0.9861 | #3 of 5 | Archive leaderboard | report |
| Click-Through Rate Prediction | Frappe | DNN + MMBAttn | AUC | 0.985 | #4 of 5 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Methods
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections