Papers › EAGLE: Eigen Aggregation Learning for Object-Centric Unsupervised Semantic Segmentation

EAGLE: Eigen Aggregation Learning for Object-Centric Unsupervised Semantic Segmentation

3 Mar 2024CVPR 2024 1arXiv:2403.01482archive 2025-07-28

Chanyoung Kim, Woojung Han, Dayun Ju, Seong Jae Hwang

Semantic segmentation has innately relied on extensive pixel-level annotated data, leading to the emergence of unsupervised methodologies. Among them, leveraging self-supervised Vision Transformers for unsupervised semantic segmentation (USS) has been making steady progress with expressive deep features. Yet, for semantically segmenting images with complex objects, a predominant challenge remains: the lack of explicit object-level semantic encoding in patch-level features. This technical limitation often leads to inadequate segmentation of complex objects with diverse structures. To address this gap, we present a novel approach, EAGLE, which emphasizes object-centric representation learning for unsupervised semantic segmentation. Specifically, we introduce EiCue, a spectral technique providing semantic and structural cues through an eigenbasis derived from the semantic similarity matrix of deep image features and color affinity from an image. Further, by incorporating our object-centric contrastive loss with EiCue, we guide our model to learn object-level representations with intra- and inter-image object-feature consistency, thereby enhancing semantic accuracy. Extensive experiments on COCO-Stuff, Cityscapes, and Potsdam-3 datasets demonstrate the state-of-the-art USS results of EAGLE with accurate and consistent semantic segmentation across complex scenes.

PaperPDFConference PDFCodeCode Syntology ran

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, Syntology's MCP tool lists every function and class Syntology harvested from this paper and whether it ran (how to connect): get_harvested_code_for_paper(arxiv_id="2403.01482")

Code

Syntology Ran 14 of 19 code samples harvested from 1 repository linked to this paper; 5 have no recorded run. Of those that ran: 2 ran · honoured contract; 1 ran · our draft was wrong; 1 ran · fixture could not drive it; 10 ran with no contract checked.

By repository: official repository: 19 samples from 1 repository, 14 ran. The run record, sample by sample. “Ran” means executed on a synthesized input, not that the code is correct or reproduces the paper.

MICV-yonsei/EAGLE officialmentioned on GitHubpytorchMIT report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

19 samples harvested; 14 ran; 2 honoured the contract we drafted; 5 have no recorded run. Read from Syntology's graph 2026-09-24; that is when this build read the record, not when the samples ran.

2ran · honoured contract
1ran · our draft was wrong
1ran · fixture could not drive it
10ran
5unverified

Licence: 0 of the 19 samples are pointer only, meaning Syntology does not serve that copy's text. This page shows no code text for any sample; each one links to its file in the repository.

Harvested from MICV-yonsei/EAGLE. “Ran” means the sample executed on a synthesized input. It does not mean the output is correct, and nothing here reproduces the paper's results. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself; “our draft was wrong” and “fixture could not drive it” are failures of Syntology's instrument, not of the code.

Each sample ends with its code_sha256, Syntology's identity for that exact code. An agent fetches the stored sample with Syntology's MCP tool get_code(code_sha256="…") (how to connect); click an identity to copy that call.

Repository labels, per sample. official repository: The archive marks this repository official for the paper. named in the paper: The archive records that the paper mentions this repository; it is not marked official. community (archive-listed): In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper. found in paper text by Syntology: Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted. community: Not in the archive's code links for this paper; a community repository Syntology harvested. Samples from a repository marked official are listed first. Licence labels name the repository's licence as recorded at harvest. “Pointer only” means Syntology does not serve that copy's text, for one of four reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; or the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar). Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence label for the reason. File links open the file on GitHub at the default branch, which may have changed since the harvest.

average_norm MICV-yonsei/EAGLE/src_EAGLE/modules.py official repository ran fingerprinted MIT (permissive) · 610531000042a850 · report
bit_get MICV-yonsei/EAGLE/src_EAGLE/data.py official repository ran fingerprinted MIT (permissive) · 9c3cc207f843ec13 · report
bool_flag MICV-yonsei/EAGLE/src_EAGLE/dino/utils.py official repository ran MIT (permissive) · c19231378e41dc5a · report
clip_gradients MICV-yonsei/EAGLE/src_EAGLE/dino/utils.py official repository ran MIT (permissive) · 2b5489053b222e00 · report
cosine_scheduler MICV-yonsei/EAGLE/src_EAGLE/dino/utils.py official repository ran · honoured contract fingerprinted MIT (permissive) · 361a6b24f11fc50a · report
drop_path MICV-yonsei/EAGLE/src_EAGLE/dino/vision_transformer.py official repository ran · fixture could not drive it fingerprinted MIT (permissive) · 55120f2026b56aa2 · report
entropy MICV-yonsei/EAGLE/src_EAGLE/train_crf.py official repository ran fingerprinted MIT (permissive) · ed616f74daccc88e · report
get_class_labels MICV-yonsei/EAGLE/src_EAGLE/train_segmentation_eigen.py official repository ran · our draft was wrong MIT (permissive) · d6f15c1eec2a900c · report
norm MICV-yonsei/EAGLE/src_EAGLE/modules.py official repository ran fingerprinted MIT (permissive) · 12de5cf1a9536fef · report
prep_for_plot MICV-yonsei/EAGLE/src_EAGLE/utils.py official repository ran MIT (permissive) · 6a6e5c247d893c0e · report
resize MICV-yonsei/EAGLE/src_EAGLE/utils.py official repository ran MIT (permissive) · d86ef5508de1f079 · report
scheduler MICV-yonsei/EAGLE/src_EAGLE/train_segmentation_eigen.py official repository ran MIT (permissive) · 475ff955e091e303 · report
shuffle MICV-yonsei/EAGLE/src_EAGLE/utils.py official repository ran · honoured contract MIT (permissive) · 205e834237bf794c · report
tensor_correlation MICV-yonsei/EAGLE/src_EAGLE/modules.py official repository ran MIT (permissive) · aa6344fded8d2fcc · report
knn_affinity MICV-yonsei/EAGLE/src_EAGLE/eigen_modules.py official repository unverified MIT (permissive) · 40459cea1c8ce129 · report
multi_seg MICV-yonsei/EAGLE/src_EAGLE/eigen_modules.py official repository unverified MIT (permissive) · 2dcb2e9af269e7cd · report
norm MICV-yonsei/EAGLE/src_EAGLE/train_crf.py official repository unverified MIT (permissive) · 503d86a1699da3e4 · report
prep MICV-yonsei/EAGLE/src_EAGLE/train_crf.py official repository unverified MIT (permissive) · a6c5c2b6d88f5429 · report
rw_affinity MICV-yonsei/EAGLE/src_EAGLE/eigen_modules.py official repository unverified MIT (permissive) · 79456f0c6d9d66da · report

Tasks

ObjectRepresentation LearningSegmentationSemantic SegmentationSemantic SimilaritySemantic Textual SimilarityUnsupervised Semantic Segmentation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Unsupervised Semantic Segmentation COCO-Stuff-27 EAGLE (DINO, ViT-S/8) Clustering [Accuracy] 64.2 #9 of 29 Archive leaderboard report
Unsupervised Semantic Segmentation COCO-Stuff-27 EAGLE (DINO, ViT-S/8) Clustering [mIoU] 27.2 #9 of 29 Archive leaderboard report
Unsupervised Semantic Segmentation COCO-Stuff-27 EAGLE (DINO, ViT-S/8) Linear Classifier [Accuracy] 76.8 #9 of 29 Archive leaderboard report
Unsupervised Semantic Segmentation COCO-Stuff-27 EAGLE (DINO, ViT-S/8) Linear Classifier [mIoU] 43.9 #9 of 29 Archive leaderboard report
Unsupervised Semantic Segmentation Cityscapes test EAGLE (DINO, ViT-B/8) Accuracy 79.4 #3 of 14 Archive leaderboard report
Unsupervised Semantic Segmentation Cityscapes test EAGLE (DINO, ViT-B/8) mIoU 22.1 #3 of 14 Archive leaderboard report
Unsupervised Semantic Segmentation Cityscapes test EAGLE (DINO, ViT-S/8) Accuracy 81.8 #7 of 14 Archive leaderboard report
Unsupervised Semantic Segmentation Cityscapes test EAGLE (DINO, ViT-S/8) mIoU 19.7 #7 of 14 Archive leaderboard report
Unsupervised Semantic Segmentation Potsdam-3 EAGLE (DINO, ViT-B/8) Accuracy 83.3 #2 of 8 Archive leaderboard report
Unsupervised Semantic Segmentation Potsdam-3 EAGLE (DINO, ViT-B/8) mIoU 71.1 #2 of 8 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections