Papers › Deep Pyramid Convolutional Neural Networks for Text Categorization
Deep Pyramid Convolutional Neural Networks for Text Categorization
Rie Johnson, Tong Zhang
This paper proposes a low-complexity word-level deep convolutional neural network (CNN) architecture for text categorization that can efficiently represent long-range associations in text. In the literature, several deep and complex neural networks have been proposed for this task, assuming availability of relatively large amounts of training data. However, the associated computational complexity increases as the networks go deeper, which poses serious challenges in practical applications. Moreover, it was shown recently that shallow word-level CNNs are more accurate and much faster than the state-of-the-art very deep nets such as character-level CNNs even in the setting of large training data. Motivated by these findings, we carefully studied deepening of word-level CNNs to capture global representations of text, and found a simple network architecture with which the best accuracy can be obtained by increasing the network depth without increasing computational cost by much. We call it deep pyramid CNN. The proposed model with 15 weight layers outperforms the previous best models on six benchmark datasets for sentiment classification and topic categorization.
Code
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Sentiment Analysis | Amazon Review Full | DPCNN | Accuracy | 65.19 | #2 of 9 | Archive leaderboard | report |
| Sentiment Analysis | Amazon Review Polarity | DPCNN | Accuracy | 96.68 | #2 of 9 | Archive leaderboard | report |
| Sentiment Analysis | Yelp Binary classification | DPCNN | Error | 2.64 | #8 of 20 | Archive leaderboard | report |
| Sentiment Analysis | Yelp Fine-grained classification | DPCNN | Error | 30.58 | #6 of 17 | Archive leaderboard | report |
| Text Classification | AG News | DPCNN | Error | 6.87 | #9 of 24 | Archive leaderboard | report |
| Text Classification | DBpedia | DPCNN | Error | 0.88 | #10 of 21 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections