Papers › Dual Transfer Learning for Event-based End-task Prediction via Pluggable Event to...

Dual Transfer Learning for Event-based End-task Prediction via Pluggable Event to Image Translation

4 Sep 2021ICCV 2021 10arXiv:2109.01801archive 2025-07-28

Lin Wang, Yujeong Chae, Kuk-Jin Yoon

Event cameras are novel sensors that perceive the per-pixel intensity changes and output asynchronous event streams with high dynamic range and less motion blur. It has been shown that events alone can be used for end-task learning, e.g., semantic segmentation, based on encoder-decoder-like networks. However, as events are sparse and mostly reflect edge information, it is difficult to recover original details merely relying on the decoder. Moreover, most methods resort to pixel-wise loss alone for supervision, which might be insufficient to fully exploit the visual details from sparse events, thus leading to less optimal performance. In this paper, we propose a simple yet flexible two-stream framework named Dual Transfer Learning (DTL) to effectively enhance the performance on the end-tasks without adding extra inference cost. The proposed approach consists of three parts: event to end-task learning (EEL) branch, event to image translation (EIT) branch, and transfer learning (TL) module that simultaneously explores the feature-level affinity information and pixel-level knowledge from the EIT branch to improve the EEL branch. This simple yet novel method leads to strong representation learning from events and is evidenced by the significant performance boost on the end-tasks such as semantic segmentation and depth estimation.

PaperPDFConference PDFCodeCode Syntology ran

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, Syntology's MCP tool lists every function and class Syntology harvested from this paper and whether it ran (how to connect): get_harvested_code_for_paper(arxiv_id="2109.01801")

Code

Syntology Ran 3 of 10 code samples harvested from 1 repository linked to this paper; 7 have no recorded run. Of those that ran: 2 ran · our draft was wrong; 1 ran with no contract checked.

By repository: official repository: 10 samples from 1 repository, 3 ran. The run record, sample by sample. “Ran” means executed on a synthesized input, not that the code is correct or reproduces the paper.

addisonwang2013/dtl officialmentioned in papermentioned on GitHubpytorchMIT report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

10 samples harvested; 3 ran; 0 honoured the contract we drafted; 7 have no recorded run. Read from Syntology's graph 2026-09-24; that is when this build read the record, not when the samples ran.

2ran · our draft was wrong
1ran
7unverified

Licence: 0 of the 10 samples are pointer only, meaning Syntology does not serve that copy's text. This page shows no code text for any sample; each one links to its file in the repository.

Harvested from addisonwang2013/DTL. “Ran” means the sample executed on a synthesized input. It does not mean the output is correct, and nothing here reproduces the paper's results. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself; “our draft was wrong” and “fixture could not drive it” are failures of Syntology's instrument, not of the code.

Each sample ends with its code_sha256, Syntology's identity for that exact code. An agent fetches the stored sample with Syntology's MCP tool get_code(code_sha256="…") (how to connect); click an identity to copy that call.

Repository labels, per sample. official repository: The archive marks this repository official for the paper. named in the paper: The archive records that the paper mentions this repository; it is not marked official. community (archive-listed): In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper. found in paper text by Syntology: Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted. community: Not in the archive's code links for this paper; a community repository Syntology harvested. Samples from a repository marked official are listed first. Licence labels name the repository's licence as recorded at harvest. “Pointer only” means Syntology does not serve that copy's text, for one of four reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; or the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar). Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence label for the reason. File links open the file on GitHub at the default branch, which may have changed since the harvest.

EITConv addisonwang2013/DTL/modeling/deeplab_dtl.py official repository ran fingerprinted MIT (permissive) · 9660609a6d6cbf98 · report
build_aspp addisonwang2013/DTL/modeling/deeplab_dtl.py official repository ran · our draft was wrong MIT (permissive) · 39265c6363db075a · report
conv3x3 addisonwang2013/dtl/backbone/drn.py official repository ran · our draft was wrong MIT (permissive) · 0e722c9ff0920473 · report
ASPP_EIT addisonwang2013/DTL/modeling/deeplab_dtl.py official repository unverified MIT (permissive) · 40529a28fb8f1e37 · report
ASPP_Fusion addisonwang2013/DTL/modeling/deeplab_dtl.py official repository unverified MIT (permissive) · 15fc6f001d543fef · report
DeepLab_Dual_V2 addisonwang2013/DTL/modeling/deeplab_dtl.py official repository unverified MIT (permissive) · 2db744a03f84a236 · report
conv_bn addisonwang2013/dtl/backbone/mobilenet.py official repository unverified MIT (permissive) · 8cf426bba4e98da5 · report
decode_segmap addisonwang2013/dtl/visualize.py official repository unverified MIT (permissive) · d50d152c6a2002ce · report
fixed_padding addisonwang2013/dtl/backbone/mobilenet.py official repository unverified MIT (permissive) · b34c12741c44b60c · report
xception addisonwang2013/dtl/backbone/xception_new.py official repository unverified MIT (permissive) · fd487be36b369be6 · report

Tasks

DecoderDepth EstimationEvent-based Object SegmentationRepresentation LearningSemantic SegmentationTransfer LearningTranslation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Event-based Object Segmentation MVSEC-SEG DTL mIoU 0.33 #4 of 8 Archive leaderboard report
Event-based Object Segmentation RGBE-SEG DTL mIoU 0.29 #5 of 8 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections