Papers › Product-based Neural Networks for User Response Prediction

Product-based Neural Networks for User Response Prediction

1 Nov 2016arXiv:1611.00144archive 2025-07-28

Yanru Qu, Han Cai, Kan Ren, Wei-Nan Zhang, Yong Yu, Ying Wen, Jun Wang

Predicting user responses, such as clicks and conversions, is of great importance and has found its usage in many Web applications including recommender systems, web search and online advertising. The data in those applications is mostly categorical and contains multiple fields; a typical representation is to transform it into a high-dimensional sparse binary feature representation via one-hot encoding. Facing with the extreme sparsity, traditional models may limit their capacity of mining shallow patterns from the data, i.e. low-order feature combinations. Deep models like deep neural networks, on the other hand, cannot be directly applied for the high-dimensional input because of the huge feature space. In this paper, we propose a Product-based Neural Networks (PNN) with an embedding layer to learn a distributed representation of the categorical data, a product layer to capture interactive patterns between inter-field categories, and further fully connected layers to explore high-order feature interactions. Our experimental results on two large-scale real-world ad click datasets demonstrate that PNNs consistently outperform the state-of-the-art models on various metrics.

PaperPDFCode

In Syntology View this paper on Syntology, its page in Syntology's graph. That page lists the repositories linked to the paper, the abstract and the calls for agents.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, on Syntology's MCP service (how to connect):

Code

Atomu2014/product-nets officialmentioned in papermentioned on GitHubtfSyntology: not harvested report
Atomu2014/product-nets-distributed mentioned on GitHubtfSyntology: not harvested report
JianzhouZhan/Awesome-RecSystem-Models mentioned on GitHubpytorchMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systems (arXiv:1803.05170; that paper's own run record: 12 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 2 honoured, 0 violated, 9 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified); nothing checks that they implement this paper's method. report
UlionTse/mlgb mentioned on GitHubpytorchSyntology: not harvested report
jamesdvance/predicting_clicks mentioned on GitHubSyntology: not harvested report
shenweichen/DeepCTR mentioned on GitHubtfSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systems (arXiv:1803.05170; that paper's own run record: 12 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 2 honoured, 0 violated, 9 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified); nothing checks that they implement this paper's method. report
shenweichen/DeepCTR-Torch mentioned on GitHubpytorchApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to... (arXiv:2008.13535; that paper's own run record: 11 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified); nothing checks that they implement this paper's method. report
tangxyw/RecAlgorithm mentioned on GitHubtfBSD-2-ClauseSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to FiBiNET: Combining Feature Importance and Bilinear feature Interaction for... (arXiv:1905.09433; that paper's own run record: 12 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 2 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 14 unverified); nothing checks that they implement this paper's method. report
wangweitong/DL mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Deep & Cross Network for Ad Click Predictions (arXiv:1708.05123; that paper's own run record: 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified) and xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systems (arXiv:1803.05170; that paper's own run record: 12 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 2 honoured, 0 violated, 9 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified); nothing checks that they implement this paper's method. report
wangweitong/recommend_system mentioned on GitHubpytorchMITSyntology: not harvested report
xue-pai/FuxiCTR mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to APG: Adaptive Parameter Generation Network for Click-Through Rate Prediction (arXiv:2203.16218; that paper's own run record: 0 ran · 1 unverified); nothing checks that they implement this paper's method. report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

A paper named beside a repository with no sample linked to this paper is shown with that paper's own run record, not this paper's: “ran” means executed on a synthesized input, not that the code is correct, and “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Papers are listed in arXiv-id order, at most three per repository.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Click-Through Rate PredictionPredictionRecommendation Systems

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Click-Through Rate Prediction Amazon PNN AUC 0.8679 #4 of 5 Archive leaderboard report
Click-Through Rate Prediction Bing News PNN AUC 0.8321 #4 of 7 Archive leaderboard report
Click-Through Rate Prediction Bing News PNN Log Loss 0.2775 #4 of 7 Archive leaderboard report
Click-Through Rate Prediction Company* PNN* AUC 0.8672 #4 of 8 Archive leaderboard report
Click-Through Rate Prediction Company* PNN* Log Loss 0.02636 #4 of 8 Archive leaderboard report
Click-Through Rate Prediction Company* IPNN AUC 0.8664 #5 of 8 Archive leaderboard report
Click-Through Rate Prediction Company* IPNN Log Loss 0.02637 #5 of 8 Archive leaderboard report
Click-Through Rate Prediction Company* OPNN AUC 0.8658 #7 of 8 Archive leaderboard report
Click-Through Rate Prediction Company* OPNN Log Loss 0.02641 #7 of 8 Archive leaderboard report
Click-Through Rate Prediction Criteo PNN* AUC 0.7987 #35 of 39 Archive leaderboard report
Click-Through Rate Prediction Criteo PNN* Log Loss 0.45214 #35 of 39 Archive leaderboard report
Click-Through Rate Prediction Criteo OPNN AUC 0.7982 #36 of 39 Archive leaderboard report
Click-Through Rate Prediction Criteo OPNN Log Loss 0.45256 #36 of 39 Archive leaderboard report
Click-Through Rate Prediction Criteo IPNN AUC 0.7972 #38 of 39 Archive leaderboard report
Click-Through Rate Prediction Criteo IPNN Log Loss 0.45323 #38 of 39 Archive leaderboard report
Click-Through Rate Prediction Dianping PNN AUC 0.8445 #3 of 5 Archive leaderboard report
Click-Through Rate Prediction Dianping PNN Log Loss 0.3424 #3 of 5 Archive leaderboard report
Click-Through Rate Prediction MovieLens 20M PNN AUC 0.7321 #5 of 6 Archive leaderboard report
Click-Through Rate Prediction iPinYou OPNN AUC 0.8174 #1 of 7 Archive leaderboard report
Click-Through Rate Prediction iPinYou IPNN AUC 0.7914 #2 of 7 Archive leaderboard report
Click-Through Rate Prediction iPinYou PNN* AUC 0.7661 #6 of 7 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections