Papers › Product-based Neural Networks for User Response Prediction

Product-based Neural Networks for User Response Prediction

1 Nov 2016arXiv:1611.00144archive 2025-07-28

Yanru Qu, Han Cai, Kan Ren, Wei-Nan Zhang, Yong Yu, Ying Wen, Jun Wang

Predicting user responses, such as clicks and conversions, is of great importance and has found its usage in many Web applications including recommender systems, web search and online advertising. The data in those applications is mostly categorical and contains multiple fields; a typical representation is to transform it into a high-dimensional sparse binary feature representation via one-hot encoding. Facing with the extreme sparsity, traditional models may limit their capacity of mining shallow patterns from the data, i.e. low-order feature combinations. Deep models like deep neural networks, on the other hand, cannot be directly applied for the high-dimensional input because of the huge feature space. In this paper, we propose a Product-based Neural Networks (PNN) with an embedding layer to learn a distributed representation of the categorical data, a product layer to capture interactive patterns between inter-field categories, and further fully connected layers to explore high-order feature interactions. Our experimental results on two large-scale real-world ad click datasets demonstrate that PNNs consistently outperform the state-of-the-art models on various metrics.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

Atomu2014/product-nets officialmentioned in papermentioned on GitHubtf report
JianzhouZhan/Awesome-RecSystem-Models mentioned on GitHubpytorchMIT report
UlionTse/mlgb mentioned on GitHubpytorch report
shenweichen/DeepCTR mentioned on GitHubtf report
shenweichen/DeepCTR-Torch mentioned on GitHubpytorchApache-2.0 report
tangxyw/RecAlgorithm mentioned on GitHubtfBSD-2-Clause report
wangweitong/DL mentioned on GitHubpytorch report
wangweitong/recommend_system mentioned on GitHubpytorchMIT report
xue-pai/FuxiCTR mentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Click-Through Rate PredictionPredictionRecommendation Systems

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Click-Through Rate Prediction Amazon PNN AUC 0.8679 #4 of 5 Archive leaderboard report
Click-Through Rate Prediction Bing News PNN AUC 0.8321 #4 of 7 Archive leaderboard report
Click-Through Rate Prediction Bing News PNN Log Loss 0.2775 #4 of 7 Archive leaderboard report
Click-Through Rate Prediction Company* PNN* AUC 0.8672 #4 of 8 Archive leaderboard report
Click-Through Rate Prediction Company* PNN* Log Loss 0.02636 #4 of 8 Archive leaderboard report
Click-Through Rate Prediction Company* IPNN AUC 0.8664 #5 of 8 Archive leaderboard report
Click-Through Rate Prediction Company* IPNN Log Loss 0.02637 #5 of 8 Archive leaderboard report
Click-Through Rate Prediction Company* OPNN AUC 0.8658 #7 of 8 Archive leaderboard report
Click-Through Rate Prediction Company* OPNN Log Loss 0.02641 #7 of 8 Archive leaderboard report
Click-Through Rate Prediction Criteo PNN* AUC 0.7987 #35 of 39 Archive leaderboard report
Click-Through Rate Prediction Criteo PNN* Log Loss 0.45214 #35 of 39 Archive leaderboard report
Click-Through Rate Prediction Criteo OPNN AUC 0.7982 #36 of 39 Archive leaderboard report
Click-Through Rate Prediction Criteo OPNN Log Loss 0.45256 #36 of 39 Archive leaderboard report
Click-Through Rate Prediction Criteo IPNN AUC 0.7972 #38 of 39 Archive leaderboard report
Click-Through Rate Prediction Criteo IPNN Log Loss 0.45323 #38 of 39 Archive leaderboard report
Click-Through Rate Prediction Dianping PNN AUC 0.8445 #3 of 5 Archive leaderboard report
Click-Through Rate Prediction Dianping PNN Log Loss 0.3424 #3 of 5 Archive leaderboard report
Click-Through Rate Prediction MovieLens 20M PNN AUC 0.7321 #5 of 6 Archive leaderboard report
Click-Through Rate Prediction iPinYou OPNN AUC 0.8174 #1 of 7 Archive leaderboard report
Click-Through Rate Prediction iPinYou IPNN AUC 0.7914 #2 of 7 Archive leaderboard report
Click-Through Rate Prediction iPinYou PNN* AUC 0.7661 #6 of 7 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections