Papers › Deep Learning over Multi-field Categorical Data: A Case Study on User Response Prediction

Deep Learning over Multi-field Categorical Data: A Case Study on User Response Prediction

11 Jan 2016arXiv:1601.02376archive 2025-07-28

Wei-Nan Zhang, Tianming Du, Jun Wang

Predicting user responses, such as click-through rate and conversion rate, are critical in many web applications including web search, personalised recommendation, and online advertising. Different from continuous raw features that we usually found in the image and audio domains, the input features in web space are always of multi-field and are mostly discrete and categorical while their dependencies are little known. Major user response prediction models have to either limit themselves to linear models or require manually building up high-order combination features. The former loses the ability of exploring feature interactions, while the latter results in a heavy computation in the large feature space. To tackle the issue, we propose two novel models using deep neural networks (DNNs) to automatically learn effective patterns from categorical feature interactions and make predictions of users' ad clicks. To get our DNNs efficiently work, we propose to leverage three feature transformation methods, i.e., factorisation machines (FMs), restricted Boltzmann machines (RBMs) and denoising auto-encoders (DAEs). This paper presents the structure of our models and their efficient training algorithms. The large-scale experiments with real-world data demonstrate that our methods work better than major state-of-the-art models.

PaperPDFCode

In Syntology View this paper on Syntology, its page in Syntology's graph. That page lists the repositories linked to the paper, the abstract and the calls for agents.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, on Syntology's MCP service (how to connect):

Code

wnzhang/deep-ctr officialmentioned in papertfSyntology: not harvested report
UlionTse/mlgb mentioned on GitHubpytorchSyntology: not harvested report
ddatta-DAC/Learning mentioned on GitHubtfSyntology: not harvested report
shenweichen/DeepCTR mentioned on GitHubtfSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systems (arXiv:1803.05170; that paper's own run record: 12 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 2 honoured, 0 violated, 9 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified); nothing checks that they implement this paper's method. report
shenweichen/DeepCTR-Torch mentioned on GitHubpytorchApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to... (arXiv:2008.13535; that paper's own run record: 11 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified); nothing checks that they implement this paper's method. report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

A paper named beside a repository with no sample linked to this paper is shown with that paper's own run record, not this paper's: “ran” means executed on a synthesized input, not that the code is correct, and “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Papers are listed in arXiv-id order, at most three per repository.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Click-Through Rate Prediction

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Click-Through Rate Prediction Company* FNN AUC 0.8683 #2 of 8 Archive leaderboard report
Click-Through Rate Prediction Company* FNN Log Loss 0.02629 #2 of 8 Archive leaderboard report
Click-Through Rate Prediction Criteo FNN AUC 0.7963 #39 of 39 Archive leaderboard report
Click-Through Rate Prediction Criteo FNN Log Loss 0.45738 #39 of 39 Archive leaderboard report
Click-Through Rate Prediction iPinYou FNN AUC 0.7619 #7 of 7 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections