Home › Code › eval_model

eval_model

Syntologyentry name in harvested coderead from the graph 2026-09-24

eval_model appears in the code Syntology harvested for 45 papers, as 49 distinct code bodies found in 50 places (a place is one code body under one paper). At least one of them ran in 17 of the papers; 0 of the code bodies carry a behaviour fingerprint.

What this page is not. Routines are grouped here by the exact string of their function or class name. Nothing asserts that two samples named eval_model do the same thing, share code, or are comparable; the name is a string, not an identity. Behaviour outputs (what a fingerprinted sample returned on the shared battery) are not in this export and are not shown here; the graph at syntology.ai holds them. "Ran" means executed on a synthesized fixture, not that the code is correct or reproduces a paper.

Samples Syntology

Syntology ran 17 of the 49 distinct code bodies named eval_model; 32 are unverified. One tile per status, in the site's fixed vocabulary, each code body counted once:

8ran · honoured contract
0ran · violated contract
3ran · our draft was wrong
0ran · fixture could not drive it
6ran
32unverified
0fingerprinted

Licence is a property of each copy, so it is counted per place: 14 of the 50 places are pointer only (Syntology does not serve that copy's text). This site shows no code text for any sample; every row below links to the file in its repository where the record names one.

“Ran” means the sample executed on a synthesized input; it does not mean the output is correct. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself; “our draft was wrong” and “fixture could not drive it” are failures of Syntology's instrument, not of the code, and those samples did run. The ran count above is every status except unverified, the same rule as each paper page.

Papers

45 papers shown of 45, newest first; 50 places in the table. A paper with no recorded date is placed by the month its arXiv id encodes, shown in the Date column as YYYY-MM (from id). One row per place: a paper whose repository defines the name more than once appears more than once, and the same code body held for several papers appears once under each, with the same status. Titles and dates are the archive's archive 2025-07-28 for papers in the archive, and the graph's for 5 papers added by Syntology; 3 papers have no page here and are shown by arXiv id only. Status and fingerprint are Syntology's record of each code body; licence is recorded for each place. The File cell ends with the code body's code_sha256, Syntology's identity for that exact code: an agent fetches the stored sample with Syntology's MCP tool get_code(code_sha256="…") (how to connect); click an identity to copy that call.

PaperDateFileStatus SyntologyLicence
Towards Resource-Efficient LLMs: End-to-End Energy Accounting of Distillation Pipelines added by Syntology 2026-05 (from id) StellarLuminosity/Energy/distill_bench/pipelines/sft_main.py a3c4618734a7e045 ran no licence file found · pointer only
Meet Dynamic Individual Preferences: Resolving Conflicting Human Value with Paired Fine-Tuning added by Syntology 2026-04 (from id) nrimsky/CAA/finetune_llama.py 88c6a4e2feade29f ran · honoured contract MIT (permissive)
In-Context Learning in Linear vs. Quadratic Attention Models: An Empirical Study on Regression Tasks added by Syntology 2026-02 (from id) Yushgoel/icl-benchmarking/src/training/evaluator.py 2ca88cb8c3b44083 unverified no licence file found · pointer only
Theory of Minimal Weight Perturbations in Deep Networks and its Applications for Low-Rank Activated Backdoor Attacks added by Syntology 2026-01 (from id) evansbeth/backdoor_attack/Backdoor/classifier_layer_bound_2.py b0e67531ca594321 unverified no licence file found · pointer only
A theory of diversity for random matrices with applications to in-context learning of Schrödinger equations added by Syntology 2026-01 (from id) LuGroupUMN/Diversity-of-random-matrices/utils/train_utils.py dd03e16bd418e81b unverified no licence file found · pointer only
Logic Gate Neural Networks are Good for Verification 26 May 2025 HyberionBrew/difflogic_verify/train_model.py db7f2c73ccce434f unverified MIT (permissive)
Transformer-Squared: Self-adaptive LLMs 9 Jan 2025 SakanaAI/self-adaptive-llms/utils.py dde83d263378109c unverified Apache-2.0 (permissive)
LLaVA Steering: Visual Instruction Tuning with 500x Fewer Parameters through Modality Linear Representation-Steering 16 Dec 2024 bibisbar/LLaVA-Steering/tinyllava/eval/model_vqa_halbench.py 3289beb8d4bdf12b unverified Apache-2.0 (permissive)
LLaVA Steering: Visual Instruction Tuning with 500x Fewer Parameters through Modality Linear Representation-Steering 16 Dec 2024 bibisbar/LLaVA-Steering/tinyllava/eval/model_vqa_mmhal.py b449ac23f340f344 unverified Apache-2.0 (permissive)
A Hitchhikers Guide to Fine-Grained Face Forgery Detection Using Common Sense Reasoning 1 Oct 2024 NickyFot/HitchhikersGuide/train_utils.py 9270af9735eeeb5e unverified Apache-2.0 (permissive)
Ensemble everything everywhere: Multi-scale aggregation for adversarial robustness 8 Aug 2024 ETH-DISCO/self-ensembling/2-self-ensemble/self_ensemble.py 0d4c870ca9878659 unverified AGPL-3.0 (copyleft) · pointer only
Commute-Time-Optimised Graphs for GNNs 9 Jul 2024 igorsterner/commute-opt-gnn/src/train_synthetic.py 7ea0be7474f38668 ran · honoured contract no licence file found · pointer only
Disentangling Masked Autoencoders for Unsupervised Domain Generalization 10 Jul 2024 rookiehb/dismae/engine_finetune.py cc0ab280ae31a4ab unverified no licence file found · pointer only
Compute Better Spent: Replacing Dense Layers with Structured Matrices 10 Jun 2024 shikaiqiu/compute-better-spent/model/fns.py 4e894cdc17d93f2c ran Apache-2.0 (permissive)
DeMamba: AI-Generated Video Detection on Million-Scale GenVideo Benchmark 30 May 2024 chenhaoxing/DeMamba/util.py 93be1c3f4d74a140 unverified Apache-2.0 (permissive)
Steering Llama 2 via Contrastive Activation Addition 9 Dec 2023 nrimsky/sycophancysteering/finetune_llama.py 88c6a4e2feade29f ran · honoured contract MIT (permissive)
Mamba: Linear-Time Sequence Modeling with Selective State Spaces 1 Dec 2023 thearkaprava/ms-temba/vim/MSTemba_main.py ad88c39d5b497053 unverified Apache-2.0 (permissive)
Automating Continual Learning 1 Dec 2023 idsia/automated-cl/utils_few_shot.py 6c71a4a7bae9d5f3 unverified MIT (permissive)
Co$^2$PT: Mitigating Bias in Pre-trained Language Models through Counterfactual Contrastive Prompt Tuning 19 Oct 2023 dongxiangjue/co2pt/eval_bios.py c59d7bc602a19b78 unverified Apache-2.0 (permissive)
In-Context Unlearning: Language Models as Few Shot Unlearners 11 Oct 2023 martinpawel/openunlearn/openunlearn/unlearners/catalog/neg_grad_plus/neg_grad_plus.py 67b0cd2c25da8b69 ran · honoured contract no licence file found · pointer only
Stochastic Gradient Descent with Preconditioned Polyak Step-size 3 Oct 2023 fxrshed/scaledsps/run_nn.py 7bf9abf72409d634 ran no licence file found · pointer only
MDTD: A Multi Domain Trojan Detector for Deep Neural Networks 30 Aug 2023 rajabia/mdtd/trainmodels.py 6f04f58d8c4d5473 ran no licence file found · pointer only
MeMOTR: Long-Term Memory-Augmented Transformer for Multi-Object Tracking 28 Jul 2023 mcg-nju/memotr/eval_engine.py 871c3d5d01b0c75a ran MIT (permissive)
Scaling Laws for Imitation Learning in Single-Agent Games 18 Jul 2023 princeton-nlp/il-scaling-in-games/il_scale/atari/eval_game.py 5a77a04ba19bba16 ran no licence file found · pointer only
Hyperparameters in Contextual RL are Highly Situational 21 Dec 2022 automl-private/crl_hpo/cRL_HPO/run_pb2.py 258d6c5cdb4f0623 ran · honoured contract Apache-2.0 (permissive)
Hyperparameters in Contextual RL are Highly Situational 21 Dec 2022 automl-private/crl_hpo/cRL_HPO/play_pb2.py c73e6161af97557b ran · honoured contract Apache-2.0 (permissive)
Unsupervised Object Representation Learning using Translation and Rotation Group Equivariant VAE 24 Oct 2022 smlc-nysbc/target-vae/train_dsprites.py a0c4d1584fb072d5 unverified MIT (permissive)
Unsupervised Object Representation Learning using Translation and Rotation Group Equivariant VAE 24 Oct 2022 smlc-nysbc/target-vae/train_galaxy.py 9769b6fef90de4d5 unverified MIT (permissive)
Functional Generalized Empirical Likelihood Estimation for Conditional Moment Restrictions 11 Jul 2022 heinerkremer/functional-gel/experiments/exp_heteroskedastic.py f20aede6409c0bb5 unverified MIT (permissive)
Testing the Ability of Language Models to Interpret Figurative Language 26 Apr 2022 simran-khanuja/multilingual-fig-qa/run_baselines.py 31e5d4061c0165ee unverified MIT (permissive)
Flexible risk design using bi-directional dispersion 28 Mar 2022 feedbackward/bdd/bdd/setup_eval.py c481ddacab52025c unverified MIT (permissive)
Equivariant graph neural networks for fast electron density estimation of molecules, liquids, and solids 1 Dec 2021 peterbjorgensen/DeepDFT/runner.py afa2f819f2fb255a unverified MIT (permissive)
CRFL: Certifiably Robust Federated Learning against Backdoor Attacks 15 Jun 2021 AI-secure/CRFL/smooth_mnist.py 4d7f485df31b3c02 ran · honoured contract no licence file found · pointer only
Proximal Causal Learning with Kernels: Two-Stage Estimation and Moment Restriction 10 May 2021 yuchen-zhu/kernel_proxies/baselines_scripts/run_zoo_experiments_more_baselines.py 163994b7dab0dc19 ran · honoured contract MIT (permissive)
F-SIOL-310: A Robotic Dataset and Benchmark for Few-Shot Incremental Object Learning 23 Mar 2021 aliayub7/cbcl-pr/training_functions.py 3c00ad285b324bd8 unverified MIT (permissive)
Learning Connectivity for Data Distribution in Robot Teams 8 Mar 2021 landonbutler/Learning-Connectivity/test_all.py 2b4b61da529b5231 ran · our draft was wrong MIT (permissive)
Towards Robustness to Label Noise in Text Classification via Noise Modeling 27 Jan 2021 thumbe3/label-noise-nlp/train_classifier.py 2e0740f9258c4c0c ran · our draft was wrong no licence file found · pointer only
Accurate, Low-Latency Visual Perception for Autonomous Racing:Challenges, Mechanisms, and Practical Solutions 28 Jul 2020 cv-core/MIT-Driverless-CV-TrainingInfra/RektNet/keypoint_tutorial_util.py 651a7b6fa2ae8d29 unverified Apache-2.0 (permissive)
FLOT: Scene Flow on Point Clouds Guided by Optimal Transport 22 Jul 2020 valeoai/FLOT/flot/scripts/val_test.py 5c7237bcc1e3ea85 unverified licence not identified · pointer only
Learning Optimal Tree Models Under Beam Search 27 Jun 2020 alibaba/x-deeplearning/xdl-algorithm-solution/DIEN/script/model.py 88e3effeb58e908b unverified Apache-2.0 (permissive)
Visual Transformers: Token-based Image Representation and Processing for Computer Vision 5 Jun 2020 aws-samples/amazon-sagemaker-visual-transformer/image-classification/code/vt-resnet-34.py 4a3aa44eded8d09b unverified MIT-0 (permissive)
To Share or Not To Share: A Comprehensive Appraisal of Weight-Sharing 11 Feb 2020 apourchot/to_share_or_not_to_share/training.py cf07dd413f297eb9 unverified MIT (permissive)
Explicitly disentangling image content from translation and rotation with spatial-VAE 25 Sep 2019 tbepler/spatial-VAE/train_mnist.py 574e22e6718a6402 ran · our draft was wrong MIT (permissive)
Explicitly disentangling image content from translation and rotation with spatial-VAE 25 Sep 2019 tbepler/spatial-VAE/train_particles.py ebc30d59ffdabf83 unverified MIT (permissive)
Explicitly disentangling image content from translation and rotation with spatial-VAE 25 Sep 2019 tbepler/spatial-VAE/train_galaxy.py 3ec7b29d649004d3 unverified MIT (permissive)
Combining Fact Extraction and Verification with Neural Semantic Matching Networks 16 Nov 2018 easonnie/combine-FEVER-NSMN/src/nli/mesim_wn_simi_v1_3.py 75be915616e6844d ran · honoured contract MIT (permissive)
Rational Recurrences 28 Aug 2018 Noahs-ARK/rational-recurrences/classification/train_classifier.py ffb793bae7c75c69 unverified MIT (permissive)
arXiv:2023.findings-emnlp.384 JHL-HUST/SparseMA/train_classifier.py b8714aa8b5678221 unverified Apache-2.0 (permissive)
arXiv:2023.findings-acl.765 qtli/EIB/code/BottleSum/finetune_BottleSelf.py 3f8c02eb208fc9e7 unverified Apache-2.0 (permissive)
arXiv:2023.acl-short.31 JFChi/PLUE/pretraining/BERT/run_mlm_no_trainer.py f3a6621055683d86 unverified MIT (permissive)

This site shows no code text; each File cell links to the file on GitHub at the repository's current default branch, which may have changed since the harvest. "Pointer only" means Syntology does not serve that copy's text, for one of four reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; or the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar). Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence cell for the reason. Per-sample records for a paper are on its paper page under "Code Syntology ran".

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections