Papers › Self-Supervised Neuron Segmentation with Multi-Agent Reinforcement Learning

Self-Supervised Neuron Segmentation with Multi-Agent Reinforcement Learning

6 Oct 2023arXiv:2310.04148archive 2025-07-28

Yinda Chen, Wei Huang, Shenglong Zhou, Qi Chen, Zhiwei Xiong

The performance of existing supervised neuron segmentation methods is highly dependent on the number of accurate annotations, especially when applied to large scale electron microscopy (EM) data. By extracting semantic information from unlabeled data, self-supervised methods can improve the performance of downstream tasks, among which the mask image model (MIM) has been widely used due to its simplicity and effectiveness in recovering original information from masked images. However, due to the high degree of structural locality in EM images, as well as the existence of considerable noise, many voxels contain little discriminative information, making MIM pretraining inefficient on the neuron segmentation task. To overcome this challenge, we propose a decision-based MIM that utilizes reinforcement learning (RL) to automatically search for optimal image masking ratio and masking strategy. Due to the vast exploration space, using single-agent RL for voxel prediction is impractical. Therefore, we treat each input patch as an agent with a shared behavior policy, allowing for multi-agent collaboration. Furthermore, this multi-agent model can capture dependencies between voxels, which is beneficial for the downstream segmentation task. Experiments conducted on representative EM datasets demonstrate that our approach has a significant advantage over alternative self-supervised methods on the task of neuron segmentation. Code is available at \url{https://github.com/ydchen0806/dbMiM}.

PaperPDFCodeCode Syntology ran

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, Syntology's MCP tool lists every function and class Syntology harvested from this paper and whether it ran (how to connect): get_harvested_code_for_paper(arxiv_id="2310.04148")

Code

Syntology Ran 20 of 24 code samples harvested from 1 repository linked to this paper; 4 have no recorded run. Of those that ran: 2 ran · honoured contract; 1 ran · violated contract; 2 ran · our draft was wrong; 15 ran with no contract checked.

By repository: official repository: 24 samples from 1 repository, 20 ran. The run record, sample by sample. “Ran” means executed on a synthesized input, not that the code is correct or reproduces the paper.

ydchen0806/dbmim officialmentioned in paperpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

24 samples harvested; 20 ran; 2 honoured the contract we drafted; 4 have no recorded run. Read from Syntology's graph 2026-09-24; that is when this build read the record, not when the samples ran.

2ran · honoured contract
1ran · violated contract
2ran · our draft was wrong
15ran
4unverified

Licence: 24 of the 24 samples are pointer only, meaning Syntology does not serve that copy's text. This page shows no code text for any sample; each one links to its file in the repository.

Harvested from ydchen0806/dbMiM. “Ran” means the sample executed on a synthesized input. It does not mean the output is correct, and nothing here reproduces the paper's results. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself; “our draft was wrong” and “fixture could not drive it” are failures of Syntology's instrument, not of the code.

Each sample ends with its code_sha256, Syntology's identity for that exact code. An agent fetches the stored sample with Syntology's MCP tool get_code(code_sha256="…") (how to connect); click an identity to copy that call.

Repository labels, per sample. official repository: The archive marks this repository official for the paper. named in the paper: The archive records that the paper mentions this repository; it is not marked official. community (archive-listed): In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper. found in paper text by Syntology: Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted. community: Not in the archive's code links for this paper; a community repository Syntology harvested. Samples from a repository marked official are listed first. Licence labels name the repository's licence as recorded at harvest. “Pointer only” means Syntology does not serve that copy's text, for one of four reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; or the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar). Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence label for the reason. File links open the file on GitHub at the default branch, which may have changed since the harvest.

DecisionModule ydchen0806/dbMiM/dbmim/models.py official repository ran fingerprinted no licence file found · pointer only · b4ad2611c31e1f3c · report
MAEOutput ydchen0806/dbMiM/dbmim/models.py official repository ran no licence file found · pointer only · ffa0da027cebb013 · report
PatchEmbed3D ydchen0806/dbMiM/dbmim/models.py official repository ran no licence file found · pointer only · 7dfdb20a93a38877 · report
TransformerBlock ydchen0806/dbMiM/dbmim/models.py official repository ran no licence file found · pointer only · a8c788e1c3eb20c1 · report
_decision_needs_edge_scores ydchen0806/dbMiM/dbmim/models.py official repository ran · violated contract no licence file found · pointer only · 640410b6903d7f7a · report
_normalize_axis_weights ydchen0806/dbMiM/dbmim/models.py official repository ran · honoured contract fingerprinted no licence file found · pointer only · 0d706bb7ac1a82b9 · report
_triple ydchen0806/dbMiM/dbmim/models.py official repository ran · honoured contract fingerprinted no licence file found · pointer only · 17347b00ad3c515c · report
affinities_to_connected_components ydchen0806/dbmim/dbmim/postprocess.py official repository ran no licence file found · pointer only · cf5e36b4f5d5bafc · report
augment_image_and_label ydchen0806/dbmim/dbmim/datasets.py official repository ran no licence file found · pointer only · ffbb8cf276ef9f02 · report
binary_iou_from_logits ydchen0806/dbmim/dbmim/metrics.py official repository ran no licence file found · pointer only · d00a010268c413ef · report
device_from_config ydchen0806/dbmim/dbmim/utils.py official repository ran no licence file found · pointer only · f0e1aff9aea1ad2d · report
dice_from_logits ydchen0806/dbmim/dbmim/metrics.py official repository ran no licence file found · pointer only · a8c9b35dce17bae5 · report
ensure_dir ydchen0806/dbmim/dbmim/utils.py official repository ran no licence file found · pointer only · 3f46792b39d12fa5 · report
gradient_loss_3d ydchen0806/dbMiM/dbmim/models.py official repository ran · our draft was wrong fingerprinted no licence file found · pointer only · 8505f28e0bda17d4 · report
is_main ydchen0806/dbmim/train_finetune.py official repository ran fingerprinted no licence file found · pointer only · 02cf333b1f5f0dd4 · report
load_config ydchen0806/dbmim/dbmim/utils.py official repository ran no licence file found · pointer only · 52e93d4c7dc1aa9b · report
membrane_edge_map_3d ydchen0806/dbMiM/dbmim/models.py official repository ran · our draft was wrong fingerprinted no licence file found · pointer only · 3dce450f399d1158 · report
normalize_volume ydchen0806/dbmim/dbmim/datasets.py official repository ran fingerprinted no licence file found · pointer only · 83684b4d0057676f · report
random_crop_3d ydchen0806/dbmim/dbmim/datasets.py official repository ran no licence file found · pointer only · a2a94ab0f75b1a93 · report
relabel_sequential ydchen0806/dbmim/dbmim/postprocess.py official repository ran fingerprinted no licence file found · pointer only · d9188e9f5325493b · report
DBMIM3DMAE ydchen0806/dbMiM/dbmim/models.py official repository unverified no licence file found · pointer only · bbe3d482f52125db · report
load_pretrained_backbone ydchen0806/dbmim/dbmim/models.py official repository unverified no licence file found · pointer only · 2c0453237d66c5cb · report
unwrap ydchen0806/dbmim/train_finetune.py official repository unverified no licence file found · pointer only · ba4d5d62b9e2f2a3 · report
watershed_fragments ydchen0806/dbmim/dbmim/postprocess.py official repository unverified no licence file found · pointer only · 925f14fbca20ff8d · report

Tasks

Multi-agent Reinforcement LearningReinforcement LearningReinforcement Learning (RL)Segmentationreinforcement-learning

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

MIM

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections