Home › Code › evaluate_model

evaluate_model

Syntologyentry name in harvested coderead from the graph 2026-09-24

evaluate_model appears in the code Syntology harvested for 54 papers, as 61 distinct code bodies found in 61 places (a place is one code body under one paper). At least one of them ran in 18 of the papers; 1 of the code bodies carries a behaviour fingerprint.

What this page is not. Routines are grouped here by the exact string of their function or class name. Nothing asserts that two samples named evaluate_model do the same thing, share code, or are comparable; the name is a string, not an identity. Behaviour outputs (what a fingerprinted sample returned on the shared battery) are not in this export and are not shown here; the graph at syntology.ai holds them. "Ran" means executed on a synthesized fixture, not that the code is correct or reproduces a paper.

Samples Syntology

Syntology ran 21 of the 61 distinct code bodies named evaluate_model; 40 are unverified. One tile per status, in the site's fixed vocabulary, each code body counted once:

5ran · honoured contract
0ran · violated contract
4ran · our draft was wrong
1ran · fixture could not drive it
11ran
40unverified
1fingerprinted

Licence is a property of each copy, so it is counted per place: 26 of the 61 places are pointer only (Syntology does not serve that copy's text). This site shows no code text for any sample; every row below links to the file in its repository where the record names one.

“Ran” means the sample executed on a synthesized input; it does not mean the output is correct. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself; “our draft was wrong” and “fixture could not drive it” are failures of Syntology's instrument, not of the code, and those samples did run. The ran count above is every status except unverified, the same rule as each paper page.

Papers

54 papers shown of 54, newest first; 61 places in the table. A paper with no recorded date is placed by the month its arXiv id encodes, shown in the Date column as YYYY-MM (from id). One row per place: a paper whose repository defines the name more than once appears more than once, and the same code body held for several papers appears once under each, with the same status. Titles and dates are the archive's archive 2025-07-28 for papers in the archive, and the graph's for 16 papers added by Syntology; 3 papers have no page here and are shown by arXiv id only. Status and fingerprint are Syntology's record of each code body; licence is recorded for each place. The File cell ends with the code body's code_sha256, Syntology's identity for that exact code: an agent fetches the stored sample with Syntology's MCP tool get_code(code_sha256="…") (how to connect); click an identity to copy that call.

PaperDateFileStatus SyntologyLicence
Assessing Quality of Experience in Natural Language Generation of German Text added by Syntology 2026-08 (from id) DFKI-NLP/TextQ/models/ats-new_integrating_features.py 130e8363ae0960d0 ran no licence file found · pointer only
Enhancing deep learning models for time series classification via knowledge distillation added by Syntology 2026-07 (from id) MSD-IRIMAS/KD-4-TSC/KD4TSC/utils.py c5bd23970f6c07e2 ran no licence file found · pointer only
UASPL: Uncertainty-Aware Self-Paced Learning with Evidential Neural Networks added by Syntology 2026-07 (from id) treelife979/UASPL/uaspl_pic/UASPL_pic.py 97ab0b10c1b915e9 ran · honoured contract no licence file found · pointer only
GRASP: Gradient-Aligned Sequential Parameter Transfer for Memory-Efficient Multi-Source Learning added by Syntology 2026-06 (from id) Sekeh-Lab/grasp-multisource-transfer/experiments/grasp/run_grasp_experiment.py 5faf0fe65b442218 unverified MIT (permissive)
Optimal Decay Spectra for Linear Recurrences added by Syntology 2026-04 (from id) SiLifen/PoST/eval_llm.py 16b3e578e4a9214a unverified Apache-2.0 (permissive)
Parameter-Efficient Fine-Tuning for Medical Text Summarization: A Comparative Study of Lora, Prompt Tuning, and Full Fine-Tuning added by Syntology 2026-03 (from id) eracoding/llm-medical-summarization/src/evaluation/evaluator.py b569afccc336defc unverified no licence file found · pointer only
LAMUS: A Large-Scale Corpus for Legal Argument Mining from U.S. Caselaw using LLMs added by Syntology 2026-03 (from id) LavanyaPobbathi/LAMUS/code/experiment/B_finetune_with_legalbench.py 5611c734b2eb1c33 unverified no licence file found · pointer only
GRaM workshop at ICLR 2026 Tiny Paper Track LATENT EQUIVARIANT OPERATORS FOR ROBUST OBJECT RECOGNITION: PROMISES AND CHALLENGES added by Syntology 20 Feb 2026 BRAIN-Aalto/equivariant_operator/training/base.py a846a651093ddd3a unverified no licence file found · pointer only
Explainable Uncertainty Quantification for Wastewater Treatment Energy Prediction via Interval Type-2 Neuro-Fuzzy System added by Syntology 2026-01 (from id) QusaiKhaled/XUQ/src/experiments/evaluate.py a3c2b1b3ce1f57fc unverified no licence file found · pointer only
FARM: Few-shot Adaptive Malware Family Classification under Concept Drift added by Syntology 2026-01 (from id) numanhg/farm/src/experiments/build_retrain_dataset.py ce0ebe6c7c84c6d8 unverified no licence file found · pointer only
DeepLeak: Privacy Enhancing Hardening of Model Explanations Against Membership Leakage added by Syntology 2026-01 (from id) um-dsp/DeepLeak/utils/evaluation.py 9050ce24d753dc98 unverified no licence file found · pointer only
Agint: Agentic Graph Compilation for Software Engineering Agents added by Syntology 2025-11 (from id) AgintHub/nifty-wilson/outputs/dagify/train_large_language_model/code/evaluate_model.py 4f3f15762881b44c unverified no licence file found · pointer only
Sketch-Augmented Features Improve Learning Long-Range Dependencies in Graph Neural Networks added by Syntology 2025-11 (from id) ryienh/sketched-random-features/srf/oversmoothing.py e430efc7cb3c7a13 unverified MIT (permissive)
Evolution Strategies at Scale: LLM Fine-Tuning Beyond Reinforcement Learning added by Syntology 2025-09 (from id) VsonicV/es-at-scale/archive/es_fine-tuning_conciseness.py f50eda6a0c64b38b unverified licence not identified · pointer only
Building Data-Driven Occupation Taxonomies: A Bottom-Up Multi-Stage Approach via Semantic Clustering and Multi-Agent Collaboration added by Syntology 2025-09 (from id) aida-ugent/CLIMB/src/train_classifier.py af8114aa86e2379e unverified licence not identified · pointer only
CrowdAgent: Multi-Agent Managed Multi-Source Annotation System added by Syntology 2025-09 (from id) QMMMS/CrowdAgent/crowd-agent-backend/src/slm_function/robust_convnextv2.py 2761c61217ad51cb unverified no licence file found · pointer only
arXiv:2506.16950 2025-06 (from id) FanfeiLi/LAION-C/laionc/evaluation.py 28f422bd4478f183 unverified MIT (permissive)
ESC: Erasing Space Concept for Knowledge Deletion 3 Apr 2025 KU-VGI/ESC/unlearn.py 8083bb6afa3f1008 unverified no licence file found · pointer only
DUET: Optimizing Training Data Mixtures via Feedback from Unseen Evaluation Tasks 1 Feb 2025 pmsdapfmbf/duet/BO.py 2642938bca13a388 ran · honoured contract Apache-2.0 (permissive)
Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Search 24 Dec 2024 phunterlau/paper_without_code/output/workflow/2411.16905/generated_code.py b20fc8d9642b452c unverified MIT (permissive)
arXiv:2411.00056 2024-11 (from id) DarianRodriguez/NegVerse/negator/Evaluation/evaluate.py 5fd9b03e5e82052a unverified no licence file found · pointer only
Subspace Optimization for Large Language Models with Convergence Guarantees 15 Oct 2024 pkumelon/Golore/torchrun_main.py f33e66905cc8abcb ran GPL-3.0 (copyleft) · pointer only
QIANets: Quantum-Integrated Adaptive Networks for Reduced Latency and Improved Inference Times in CNN Models 14 Oct 2024 edwardmagongo/quantum-inspired-model-compression/densenet.py 66d2c815d123a991 ran · honoured contract MIT (permissive)
LoLCATs: On Low-Rank Linearizing of Large Language Models 14 Oct 2024 HazyResearch/lolcats/distill_llama.py 99199bb3bba7f5ed unverified Apache-2.0 (permissive)
Conformal Structured Prediction 8 Oct 2024 botong516/conformal_structured_prediction/run/imagenet.py edbfb59fb3879819 ran fingerprinted no licence file found · pointer only
AutoML-Agent: A Multi-Agent LLM Framework for Full-Pipeline AutoML 3 Oct 2024 DeepAuto-AI/automl-agent/prompt_pool/image_classification.py 85044f46d9712e2b unverified no licence file found · pointer only
AutoML-Agent: A Multi-Agent LLM Framework for Full-Pipeline AutoML 3 Oct 2024 DeepAuto-AI/automl-agent/prompt_pool/node_classification.py e923c7c2b3aea681 unverified no licence file found · pointer only
Identifying Knowledge Editing Types in Large Language Models 29 Sep 2024 xpq-tech/keti/abalation_closellm.py 91a84b1a09f3183e ran MIT (permissive)
Identifying Knowledge Editing Types in Large Language Models 29 Sep 2024 xpq-tech/keti/close_source_llms_main.py 611b5daad6c596b7 ran MIT (permissive)
Learning vs Retrieval: The Role of In-Context Examples in Regression with LLMs 6 Sep 2024 HLR/LvsR-LLM/Datasets/model_training.py ee73f674640a4661 ran no licence file found · pointer only
xLSTM: Extended Long Short-Term Memory 7 May 2024 gonzalopezgil/xlstm-ts/src/ml/models/xlstm_ts/training.py eefa6a8362a8958c unverified MIT (permissive)
Visual Decoding and Reconstruction via EEG Embeddings with Guided Diffusion 2024-03 (from id) dongyangli-del/eeg_image_decode/Generation/ATMS_reconstruction.py dde08c57d862ec73 ran · our draft was wrong MIT (permissive)
Visual Decoding and Reconstruction via EEG Embeddings with Guided Diffusion 2024-03 (from id) dongyangli-del/eeg_image_decode/Retrieval/ATMS_retrieval.py a8f9f460931bbeb6 ran · our draft was wrong MIT (permissive)
Visual Decoding and Reconstruction via EEG Embeddings with Guided Diffusion 2024-03 (from id) nzwang/neural-mcrl/EEGToVisual/NeuralMCRL.py 1979eed793bbbbf9 unverified no licence file found · pointer only
Tree-Regularized Tabular Embeddings 1 Mar 2024 milanlx/tree-regularized-embedding/src/train_tree.py ecfcea6bb0afa1b9 ran · honoured contract MIT (permissive)
Evading Data Contamination Detection for Language Models is (too) Easy 5 Feb 2024 eth-sri/malicious-contamination/code-contamination-detection/src/utils.py 01d6eba772ddf7c2 unverified Apache-2.0 (permissive)
ESPnet-SPK: full pipeline speaker embedding toolkit with reproducible recipes, self-supervised front-ends, and off-the-shelf models 30 Jan 2024 Jungjee/RawNet/python/RawNet1/PyTorch/train_RawNet.py bb8e18446e6e5c44 ran MIT (permissive)
LLM-as-a-Coauthor: Can Mixed Human-Written and Machine-Generated Text Be Detected? 11 Jan 2024 dongping-chen/mixset/methods/radar.py 23449ffb5d7ab7b0 unverified no licence file found · pointer only
Online Test-Time Adaptation of Spatial-Temporal Traffic Flow Forecasting 8 Jan 2024 pengxin-guo/adcsd/libcity/evaluator/utils.py 9b199ea651c27032 unverified no licence file found · pointer only
Curated LLM: Synergy of LLMs and Data Curation for tabular augmentation in low-data regimes 19 Dec 2023 vanderschaarlab/cllm/src/cllm/utils.py 8097d26afff455d8 ran Apache-2.0 (permissive)
Towards Robust Multi-Modal Reasoning via Model Selection 12 Oct 2023 LINs-lab/M3/MS-GQA/code/run_m3.py a1cb3bb3f6e48673 unverified Apache-2.0 (permissive)
Towards Robust Multi-Modal Reasoning via Model Selection 12 Oct 2023 LINs-lab/M3/MS-GQA/code/run_ncf++.py 80cf4f2a02aa0335 unverified Apache-2.0 (permissive)
FedSOL: Stabilized Orthogonal Learning with Proximal Restrictions in Federated Learning 24 Aug 2023 Lee-Gihun/FedSOL/algorithms/measures.py aa1b8a2c60165efc ran MIT (permissive)
ReLoRA: High-Rank Training Through Low-Rank Updates 11 Jul 2023 guitaricet/relora/torchrun_main.py 6cd1023ec2204c22 unverified Apache-2.0 (permissive)
Investigating the Effect of Misalignment on Membership Privacy in the White-box Setting 8 Jun 2023 microsoft/shadow-realignment-mia/train_controlled_randomness.py 3528a0b4188e1ed8 ran MIT (permissive)
LEACE: Perfect linear concept erasure in closed form 6 Jun 2023 FairUnlearn/detoxai/src/detoxai/core/evaluation.py 375ff94b7f4a2397 unverified MIT (permissive)
Data-IQ: Characterizing subgroups with heterogeneous outcomes in tabular data 24 Oct 2022 seedatnabeel/data-iq/src/utils/group_dro_helpers.py 74b9aada2ba5b3c6 unverified MIT (permissive)
TCT: Convexifying Federated Learning using Bootstrapped Neural Tangent Kernels 13 Jul 2022 yaodongyu/tct/mnist/utils.py bca65ccbc3175672 ran · fixture could not drive it no licence file found · pointer only
When does Bias Transfer in Transfer Learning? 6 Jul 2022 MadryLab/bias-transfer/src/eval_utils.py 8e3e794b7f3dd5f7 unverified MIT (permissive)
Self-supervised Learning for Human Activity Recognition Using 700,000 Person-days of Wearable Data 6 Jun 2022 OxWearables/ssl-wearables/mtl.py 6a84d2950d1a7b4c ran · our draft was wrong licence not identified · pointer only
Self-supervised Learning for Human Activity Recognition Using 700,000 Person-days of Wearable Data 6 Jun 2022 OxWearables/ssl-wearables/downstream_task_evaluation.py a8d567ee48f89c59 ran · honoured contract licence not identified · pointer only
Testing the Ability of Language Models to Interpret Figurative Language 26 Apr 2022 nightingal3/fig-qa/src/models/gpt_score.py 2a5615f598f3af2b ran · our draft was wrong MIT (permissive)
HumBugDB: A Large-scale Acoustic Mosquito Dataset 14 Oct 2021 HumBug-Mosquito/HumBugDB/lib/Keras/runKeras.py fffbb3c08c0354be unverified MIT (permissive)
Visual Representation Learning Does Not Generalize Strongly Within the Same Domain 17 Jul 2021 bethgelab/InDomainGeneralizationBenchmark/src/lablet_generalization_benchmark/evaluate_model.py 84a0f2cd3abb6e6f unverified Apache-2.0 (permissive)
Counterexample-Guided Learning of Monotonic Neural Networks 16 Jun 2020 AishwaryaSivaraman/COMET/src/ModelCalls.py 357f326cc7f53e40 unverified MIT (permissive)
Neural Jump Ordinary Differential Equations: Consistent Continuous-Time Prediction and Filtering 8 Jun 2020 HerreraKrachTeichmann/ControlledODERNN/NJODE/physionet_train.py e7c9692657b50119 unverified MIT (permissive)
Neural Jump Ordinary Differential Equations: Consistent Continuous-Time Prediction and Filtering 8 Jun 2020 HerreraKrachTeichmann/ControlledODERNN/NJODE/climate_train.py 172c6c49b142f584 unverified MIT (permissive)
PushNet: Efficient and Adaptive Neural Message Passing 4 Mar 2020 buschju/pushnet/src/training.py 03b3243eaff8a95c unverified MIT (permissive)
Learning Calibratable Policies using Programmatic Style-Consistency 2 Oct 2019 kushaltirumala/callibratable_style_consistency_flies/eval_model.py f186f46f003e4331 unverified MIT (permissive)
PadChest: A large chest x-ray image dataset with multi-label annotated reports 22 Jan 2019 rajpurkarlab/chexzero/metrics.py 5dba521f400b96c2 unverified MIT (permissive)
arXiv:2025.emnlp-main.472 FKarl/HYDRA/hydra_experiments.py 67890948491fe2e0 unverified MIT (permissive)

This site shows no code text; each File cell links to the file on GitHub at the repository's current default branch, which may have changed since the harvest. "Pointer only" means Syntology does not serve that copy's text, for one of four reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; or the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar). Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence cell for the reason. Per-sample records for a paper are on its paper page under "Code Syntology ran".

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections