Papers › ATISS: Autoregressive Transformers for Indoor Scene Synthesis

ATISS: Autoregressive Transformers for Indoor Scene Synthesis

7 Oct 2021NeurIPS 2021 12arXiv:2110.03675archive 2025-07-28

Despoina Paschalidou, Amlan Kar, Maria Shugrina, Karsten Kreis, Andreas Geiger, Sanja Fidler

The ability to synthesize realistic and diverse indoor furniture layouts automatically or based on partial input, unlocks many applications, from better interactive 3D tools to data synthesis for training and simulation. In this paper, we present ATISS, a novel autoregressive transformer architecture for creating diverse and plausible synthetic indoor environments, given only the room type and its floor plan. In contrast to prior work, which poses scene synthesis as sequence generation, our model generates rooms as unordered sets of objects. We argue that this formulation is more natural, as it makes ATISS generally useful beyond fully automatic room layout synthesis. For example, the same trained model can be used in interactive applications for general scene completion, partial room re-arrangement with any objects specified by the user, as well as object suggestions for any partial room. To enable this, our model leverages the permutation equivariance of the transformer when conditioning on the partial scene, and is trained to be permutation-invariant across object orderings. Our model is trained end-to-end as an autoregressive generative model using only labeled 3D bounding boxes as supervision. Evaluations on four room types in the 3D-FRONT dataset demonstrate that our model consistently generates plausible room layouts that are more realistic than existing methods. In addition, it has fewer parameters, is simpler to implement and train and runs up to 8 times faster than existing methods.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

nv-tlabs/atiss officialpytorchNOASSERTION report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

2D Semantic Segmentation task 1 (8 classes)3D Semantic Scene CompletionIndoor Scene Synthesis

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
3D Semantic Scene Completion PRO-teXt ATISS CD 2.0756 #4 of 4 Archive leaderboard report
3D Semantic Scene Completion PRO-teXt ATISS CMD 1.4140 #4 of 4 Archive leaderboard report
3D Semantic Scene Completion PRO-teXt ATISS F1 0.0663 #4 of 4 Archive leaderboard report
Indoor Scene Synthesis PRO-teXt ATISS CD 2.0756 #3 of 4 Archive leaderboard report
Indoor Scene Synthesis PRO-teXt ATISS EMD 1.4140 #3 of 4 Archive leaderboard report
Indoor Scene Synthesis PRO-teXt ATISS F1 0.0663 #3 of 4 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections