Papers › NeuriCam: Key-Frame Video Super-Resolution and Colorization for IoT Cameras

NeuriCam: Key-Frame Video Super-Resolution and Colorization for IoT Cameras

25 Jul 2022arXiv:2207.12496archive 2025-07-28

Bandhav Veluri, Collin Pernu, Ali Saffari, Joshua Smith, Michael Taylor, Shyamnath Gollakota

We present NeuriCam, a novel deep learning-based system to achieve video capture from low-power dual-mode IoT camera systems. Our idea is to design a dual-mode camera system where the first mode is low-power (1.1 mW) but only outputs grey-scale, low resolution, and noisy video and the second mode consumes much higher power (100 mW) but outputs color and higher resolution images. To reduce total energy consumption, we heavily duty cycle the high power mode to output an image only once every second. The data for this camera system is then wirelessly sent to a nearby plugged-in gateway, where we run our real-time neural network decoder to reconstruct a higher-resolution color video. To achieve this, we introduce an attention feature filter mechanism that assigns different weights to different features, based on the correlation between the feature map and the contents of the input frame at each spatial location. We design a wireless hardware prototype using off-the-shelf cameras and address practical issues including packet loss and perspective mismatch. Our evaluations show that our dual-camera approach reduces energy consumption by 7x compared to existing systems. Further, our model achieves an average greyscale PSNR gain of 3.7 dB over prior single and dual-camera video super-resolution methods and 5.6 dB RGB gain over prior color propagation methods. Open-source code: https://github.com/vb000/NeuriCam.

PaperPDFCode

Code

vb000/neuricam officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

ColorizationKey-Frame-based Video Super-Resolution (K = 15)Super-ResolutionVideo Super-Resolution

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Key-Frame-based Video Super-Resolution (K = 15) UDM10 - 4x upscaling NeuriCam-net PSNR 42.03 #1 of 1 Archive leaderboard report
Key-Frame-based Video Super-Resolution (K = 15) UDM10 - 4x upscaling NeuriCam-net SSIM 0.9814 #1 of 1 Archive leaderboard report
Key-Frame-based Video Super-Resolution (K = 15) Vid4 - 4x upscaling NeuriCam-net PSNR 31.36 #1 of 1 Archive leaderboard report
Key-Frame-based Video Super-Resolution (K = 15) Vid4 - 4x upscaling NeuriCam-net SSIM 0.9330 #1 of 1 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Introduced by this paper: Attention Feature Filters

Attention Feature FiltersColorizationDeformable ConvolutionPixelShuffle

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections