Papers › Deep Learning over Multi-field Categorical Data: A Case Study on User Response Prediction
Deep Learning over Multi-field Categorical Data: A Case Study on User Response Prediction
Wei-Nan Zhang, Tianming Du, Jun Wang
Predicting user responses, such as click-through rate and conversion rate, are critical in many web applications including web search, personalised recommendation, and online advertising. Different from continuous raw features that we usually found in the image and audio domains, the input features in web space are always of multi-field and are mostly discrete and categorical while their dependencies are little known. Major user response prediction models have to either limit themselves to linear models or require manually building up high-order combination features. The former loses the ability of exploring feature interactions, while the latter results in a heavy computation in the large feature space. To tackle the issue, we propose two novel models using deep neural networks (DNNs) to automatically learn effective patterns from categorical feature interactions and make predictions of users' ad clicks. To get our DNNs efficiently work, we propose to leverage three feature transformation methods, i.e., factorisation machines (FMs), restricted Boltzmann machines (RBMs) and denoising auto-encoders (DAEs). This paper presents the structure of our models and their efficient training algorithms. The large-scale experiments with real-world data demonstrate that our methods work better than major state-of-the-art models.
In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
Code
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Click-Through Rate Prediction | Company* | FNN | AUC | 0.8683 | #2 of 8 | Archive leaderboard | report |
| Click-Through Rate Prediction | Company* | FNN | Log Loss | 0.02629 | #2 of 8 | Archive leaderboard | report |
| Click-Through Rate Prediction | Criteo | FNN | AUC | 0.7963 | #39 of 39 | Archive leaderboard | report |
| Click-Through Rate Prediction | Criteo | FNN | Log Loss | 0.45738 | #39 of 39 | Archive leaderboard | report |
| Click-Through Rate Prediction | iPinYou | FNN | AUC | 0.7619 | #7 of 7 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections