Papers › Parsing Natural Scenes and Natural Language with Recursive Neural Networks

Parsing Natural Scenes and Natural Language with Recursive Neural Networks

1 Jun 2011Proceedings of the 26th International Conference on Machine Learning (ICML) 2011 2011 6archive 2025-07-28

Richard Socher,Cliff Chiung-Yu Lin,Andrew Y. Ng,Christopher D. Manning

Recursive structure is commonly found in the inputs of different modalities such as natural scene images or natural language sentences.Discovering this recursive structure helps us to not only identify the units that an image or sentence contains but also how they interact to form a whole. We introduce a max-margin structure prediction architecture based on recursive neural networks that can successfully recover such structure both in complex scene images as well as sentences. The same algorithm can be used both to provide a competitive syntactic parser for natural language sentences from the Penn Treebank and to out-perform alternative approaches for semantic scene segmentation, annotation and classification. For segmentation and annotation our algorithm obtains a new level of state-of-the-art performance on the Stanford background dataset (78.1%). The features from the im-age parse tree outperform Gist descriptors forscene classification by 4%.

PaperPDFCode

Code

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

General ClassificationScene ClassificationScene SegmentationScene UnderstandingSegmentationSentence

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections