{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/aperture-diffraction-for-compact-snapshot-1","title":"Aperture Diffraction for Compact Snapshot Spectral Imaging","arxiv_id":"2309.16372","date":"2023-09-27","proceeding":"ICCV 2023 1","authors":["Tao Lv","Hao Ye","Quan Yuan","Zhan Shi","Yibo Wang","Shuming Wang","Xun Cao"],"abstract":"We demonstrate a compact, cost-effective snapshot spectral imaging system named Aperture Diffraction Imaging Spectrometer (ADIS), which consists only of an imaging lens with an ultra-thin orthogonal aperture mask and a mosaic filter sensor, requiring no additional physical footprint compared to common RGB cameras. Then we introduce a new optical design that each point in the object space is multiplexed to discrete encoding locations on the mosaic filter sensor by diffraction-based spatial-spectral projection engineering generated from the orthogonal mask. The orthogonal projection is uniformly accepted to obtain a weakly calibration-dependent data form to enhance modulation robustness. Meanwhile, the Cascade Shift-Shuffle Spectral Transformer (CSST) with strong perception of the diffraction degeneration is designed to solve a sparsity-constrained inverse problem, realizing the volume reconstruction from 2D measurements with Large amount of aliasing. Our system is evaluated by elaborating the imaging optical theory and reconstruction algorithm with demonstrating the experimental imaging under a single exposure. Ultimately, we achieve the sub-super-pixel spatial resolution and high spectral resolution imaging. The code will be available at: https://github.com/Krito-ex/CSST.","url_abs":"https://arxiv.org/abs/2309.16372v1","url_pdf":"https://arxiv.org/pdf/2309.16372v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"aperture-diffraction-for-compact-snapshot-1","repo_url":"https://github.com/krito-ex/csst","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[],"methods":[{"method_slug":"absolute-position-encodings","method_name":"Absolute Position Encodings"},{"method_slug":"adam","method_name":"Adam"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"bpe","method_name":"BPE"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"label-smoothing","method_name":"Label Smoothing"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"position-wise-feed-forward-layer","method_name":"Position-Wise Feed-Forward Layer"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"transformer","method_name":"Transformer"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2309.16372","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2309.16372"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/Krito-ex/CSST","reach":null}],"summary":{"ran":1,"unverified":4},"by_repo_kind":{"official":{"samples":5,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"68eb5afedfca645e","entry":"QECNet","repo":"Krito-ex/CSST","repo_kind":"official","path":"Real/train_code/architecture/CSST.py","file_url":"https://github.com/Krito-ex/CSST/blob/HEAD/Real/train_code/architecture/CSST.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"68eb5afedfca645e"}},{"code_sha256_prefix":"0af721b8739a0eea","entry":"CSST","repo":"Krito-ex/CSST","repo_kind":"official","path":"Real/train_code/architecture/CSST.py","file_url":"https://github.com/Krito-ex/CSST/blob/HEAD/Real/train_code/architecture/CSST.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0af721b8739a0eea"}},{"code_sha256_prefix":"5e20d3cb09486dff","entry":"SSAB","repo":"Krito-ex/CSST","repo_kind":"official","path":"Real/train_code/architecture/CSST.py","file_url":"https://github.com/Krito-ex/CSST/blob/HEAD/Real/train_code/architecture/CSST.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5e20d3cb09486dff"}},{"code_sha256_prefix":"29ba9d287789e444","entry":"SST","repo":"Krito-ex/CSST","repo_kind":"official","path":"Real/train_code/architecture/CSST.py","file_url":"https://github.com/Krito-ex/CSST/blob/HEAD/Real/train_code/architecture/CSST.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"29ba9d287789e444"}},{"code_sha256_prefix":"5597b52cdd83fdbe","entry":"SS_MSA","repo":"Krito-ex/CSST","repo_kind":"official","path":"Real/train_code/architecture/CSST.py","file_url":"https://github.com/Krito-ex/CSST/blob/HEAD/Real/train_code/architecture/CSST.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5597b52cdd83fdbe"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}