Papers › GaussianGrasper: 3D Language Gaussian Splatting for Open-vocabulary Robotic Grasping

GaussianGrasper: 3D Language Gaussian Splatting for Open-vocabulary Robotic Grasping

14 Mar 2024arXiv:2403.09637archive 2025-07-28

Yuhang Zheng, Xiangyu Chen, Yupeng Zheng, Songen Gu, Runyi Yang, Bu Jin, Pengfei Li, Chengliang Zhong, Zengmao Wang, Lina Liu, Chao Yang, Dawei Wang, Zhen Chen, Xiaoxiao Long, Meiqing Wang

Constructing a 3D scene capable of accommodating open-ended language queries, is a pivotal pursuit, particularly within the domain of robotics. Such technology facilitates robots in executing object manipulations based on human language directives. To tackle this challenge, some research efforts have been dedicated to the development of language-embedded implicit fields. However, implicit fields (e.g. NeRF) encounter limitations due to the necessity of processing a large number of input views for reconstruction, coupled with their inherent inefficiencies in inference. Thus, we present the GaussianGrasper, which utilizes 3D Gaussian Splatting to explicitly represent the scene as a collection of Gaussian primitives. Our approach takes a limited set of RGB-D views and employs a tile-based splatting technique to create a feature field. In particular, we propose an Efficient Feature Distillation (EFD) module that employs contrastive learning to efficiently and accurately distill language embeddings derived from foundational models. With the reconstructed geometry of the Gaussian field, our method enables the pre-trained grasping model to generate collision-free grasp pose candidates. Furthermore, we propose a normal-guided grasp module to select the best grasp pose. Through comprehensive real-world experiments, we demonstrate that GaussianGrasper enables robots to accurately query and grasp objects with language instructions, providing a new solution for language-guided manipulation tasks. Data and codes can be available at https://github.com/MrSecant/GaussianGrasper.

PaperPDFCodeCode Syntology ran

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, Syntology's MCP tool lists every function and class Syntology harvested from this paper and whether it ran (how to connect): get_harvested_code_for_paper(arxiv_id="2403.09637")

Code

Syntology Ran 8 of 8 code samples harvested from 1 repository linked to this paper; 0 have no recorded run. Of those that ran: 2 ran · honoured contract; 6 ran with no contract checked.

By repository: official repository: 8 samples from 1 repository, 8 ran. The run record, sample by sample. “Ran” means executed on a synthesized input, not that the code is correct or reproduces the paper.

mrsecant/gaussiangrasper officialmentioned in papermentioned on GitHubjax report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

8 samples harvested; 8 ran; 2 honoured the contract we drafted; 0 have no recorded run. Read from Syntology's graph 2026-09-24; that is when this build read the record, not when the samples ran.

2ran · honoured contract
6ran

Licence: 8 of the 8 samples are pointer only, meaning Syntology does not serve that copy's text. This page shows no code text for any sample; each one links to its file in the repository.

Harvested from mrsecant/gaussiangrasper. “Ran” means the sample executed on a synthesized input. It does not mean the output is correct, and nothing here reproduces the paper's results. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself; “our draft was wrong” and “fixture could not drive it” are failures of Syntology's instrument, not of the code.

Each sample ends with its code_sha256, Syntology's identity for that exact code. An agent fetches the stored sample with Syntology's MCP tool get_code(code_sha256="…") (how to connect); click an identity to copy that call.

Repository labels, per sample. official repository: The archive marks this repository official for the paper. named in the paper: The archive records that the paper mentions this repository; it is not marked official. community (archive-listed): In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper. found in paper text by Syntology: Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted. community: Not in the archive's code links for this paper; a community repository Syntology harvested. Samples from a repository marked official are listed first. Licence labels name the repository's licence as recorded at harvest. “Pointer only” means Syntology does not serve that copy's text, for one of four reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; or the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar). Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence label for the reason. File links open the file on GitHub at the default branch, which may have changed since the harvest.

RGB2SH mrsecant/gaussiangrasper/nerfstudio/models/gaussian_splatting.py official repository ran · honoured contract fingerprinted no licence file found · pointer only · 3d2c1a432b1a3561 · report
SH2RGB mrsecant/gaussiangrasper/nerfstudio/models/gaussian_splatting.py official repository ran · honoured contract fingerprinted no licence file found · pointer only · 508a98451f5b78fe · report
lossfun_outer mrsecant/gaussiangrasper/nerfstudio/model_components/losses.py official repository ran no licence file found · pointer only · f1e7d68796e89ab2 · report
merge_methods mrsecant/gaussiangrasper/nerfstudio/configs/method_configs.py official repository ran no licence file found · pointer only · c64c9a3a66a1d0c8 · report
outer mrsecant/gaussiangrasper/nerfstudio/model_components/losses.py official repository ran no licence file found · pointer only · de818de3a5e2a784 · report
random_quat_tensor mrsecant/gaussiangrasper/nerfstudio/models/gaussian_splatting.py official repository ran fingerprinted no licence file found · pointer only · af506abe9226350c · report
ray_samples_to_sdist mrsecant/gaussiangrasper/nerfstudio/model_components/losses.py official repository ran no licence file found · pointer only · 34a1673bf755a59b · report
sort_methods mrsecant/gaussiangrasper/nerfstudio/configs/method_configs.py official repository ran no licence file found · pointer only · 06036a2535dc9b18 · report

Tasks

Contrastive LearningNeRFRobotic GraspingSimulated Gaussian Manipulation

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

Contrastive LearningSET

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections