Home › Code › exact_match

exact_match

Syntologyentry name in harvested coderead from the graph 2026-09-24

exact_match appears in the code Syntology harvested for 23 papers, as 22 distinct code bodies found in 23 places (a place is one code body under one paper). At least one of them ran in 17 of the papers; 10 of the code bodies carry a behaviour fingerprint.

What this page is not. Routines are grouped here by the exact string of their function or class name. Nothing asserts that two samples named exact_match do the same thing, share code, or are comparable; the name is a string, not an identity. Behaviour outputs (what a fingerprinted sample returned on the shared battery) are not in this export and are not shown here; the graph at syntology.ai holds them. "Ran" means executed on a synthesized fixture, not that the code is correct or reproduces a paper.

Samples Syntology

Syntology ran 16 of the 22 distinct code bodies named exact_match; 6 are unverified. One tile per status, in the site's fixed vocabulary, each code body counted once:

1ran · honoured contract
3ran · violated contract
0ran · our draft was wrong
0ran · fixture could not drive it
12ran
6unverified
10fingerprinted

Licence is a property of each copy, so it is counted per place: 8 of the 23 places are pointer only (Syntology does not serve that copy's text). This site shows no code text for any sample; every row below links to the file in its repository where the record names one.

“Ran” means the sample executed on a synthesized input; it does not mean the output is correct. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself; “our draft was wrong” and “fixture could not drive it” are failures of Syntology's instrument, not of the code, and those samples did run. The ran count above is every status except unverified, the same rule as each paper page.

Papers

23 papers shown of 23, newest first; 23 places in the table. A paper with no recorded date is placed by the month its arXiv id encodes, shown in the Date column as YYYY-MM (from id). One row per place: a paper whose repository defines the name more than once appears more than once, and the same code body held for several papers appears once under each, with the same status. Titles and dates are the archive's archive 2025-07-28 for papers in the archive, and the graph's for 9 papers added by Syntology; 1 papers have no page here and are shown by arXiv id only. Status and fingerprint are Syntology's record of each code body; licence is recorded for each place. The File cell ends with the code body's code_sha256, Syntology's identity for that exact code: an agent fetches the stored sample with Syntology's MCP tool get_code(code_sha256="…") (how to connect); click an identity to copy that call.

PaperDateFileStatus SyntologyLicence
Model of Models: When Does Emitting a Specialist Beat Attending, Adapting, or Tuning? A Controlled Cross-Domain Study of Amortized Weight Generation added by Syntology 2026-08 (from id) johnchowell/Model-of-Models/exp16_arc.py 8b3aae2b84b3210e ran fingerprinted MIT (permissive)
Beyond "What to Retrieve": Uncertainty in Retrieval-Augmented Code Generation added by Syntology 2026-07 (from id) Rocky5502/OpenCoder_V1/opencoder/evaluation/metrics.py 095c99ea52e24d66 ran fingerprinted MIT (permissive)
RIMS: Preference Optimization via Smoothed Multi-pair Aggregation for Small-Scale LLM Retrieval-Augmented Generation added by Syntology 2026-07 (from id) tptrix29/RIMS/baseline/baseline_instructrag.py 693e3eb42781f873 ran fingerprinted MIT (permissive)
DMF: A Deterministic Memory Framework for Conversational AI Agents added by Syntology 2026-06 (from id) matstech/dmf-benchmarks/dmf_bench/benchmarks/locomo/rigorous.py 6aea303b6aec6c67 ran fingerprinted MIT (permissive)
ComplexMCP: Evaluation of LLM Agents in Dynamic, Interdependent, and Large-Scale Tool Sandbox added by Syntology 2026-05 (from id) AIDC-AI/complex-mcp/benchmark/judge.py 051ed74b766c82aa ran fingerprinted MIT (permissive)
RSAT: Structured Attribution Makes Small Language Models Faithful Table Reasoners added by Syntology 2026-05 (from id) JugalGajjar/RSAT/src/rewards/answer_reward.py 8200854ddbd775fd ran fingerprinted MIT (permissive)
Reinforcement Learning with Conditional Expectation Reward added by Syntology 2026-03 (from id) changyi7231/CER/recipe/cer/src/reward_manager.py bacda3216fdce102 unverified Apache-2.0 (permissive)
Small Reward Models via Backward Inference added by Syntology 2026-02 (from id) yikee/FLIP/open-instruct/decontamination/search.py b9ce489e37ca0182 unverified no licence file found · pointer only
EverTracer: Hunting Stolen Large Language Models via Stealthy and Robust Probabilistic Fingerprint added by Syntology 2025-09 (from id) Xuzhenhua55/EverTracer/Utils/evaluation.py ab51854fed6480f7 unverified no licence file found · pointer only
Data Whisperer: Efficient Data Selection for Task-Specific LLM Fine-Tuning via Few-Shot In-Context Learning 18 May 2025 gszfwsb/Data-Whisperer/pruning/datawhisperer_gsm_pruner.py 7d4e720c5eec0e6f ran · violated contract fingerprinted no licence file found · pointer only
Mind the Gap: Benchmarking Spatial Reasoning in Vision-Language Models 25 Mar 2025 stogiannidis/srbench/src/eval/acc.py 512557f1eb973e22 unverified MIT (permissive)
SMARTCAL: An Approach to Self-Aware Tool-Use Evaluation and Calibration 11 Dec 2024 Henrysyh2000/SMARTCAL/ART_SM_CAL/art_uw.py a442b0bd917515d1 unverified MIT (permissive)
SURf: Teaching Large Vision-Language Models to Selectively Utilize Retrieved Information 21 Sep 2024 GasolSun36/SURf/initial/tool_evaluate.py 442f044af42b5b3f ran fingerprinted no licence file found · pointer only
Generate-on-Graph: Treat LLM as both Agent and KG in Incomplete Knowledge Graph Question Answering 23 Apr 2024 YaooXu/GoG/src/evaluate.py d37ef44866e11f1d ran no licence file found · pointer only
IDGenRec: LLM-RecSys Alignment with Textual ID Learning 27 Mar 2024 agiresearch/idgenrec/src/utils/generation_trie.py ddaa9fa31e2c803d ran no licence file found · pointer only
Online Adaptation of Language Models with a Memory of Amortized Contexts 7 Mar 2024 jihoontack/mac/models/amortized_encdec.py 64702a446a4111bd ran · violated contract MIT (permissive)
PromptKD: Distilling Student-Friendly Knowledge for Generative Language Models via Prompt Tuning 20 Feb 2024 gmkim-ai/promptkd/rouge_metric.py 61c5ad3a7b3c5731 ran MIT (permissive)
Prompt Optimization via Adversarial In-Context Learning 5 Dec 2023 zhaoyiran924/adv-in-context-learning/eval/automatic/evaluation.py 41e978babf390372 ran no licence file found · pointer only
Can Large Language Models be Good Path Planners? A Benchmark and Investigation on Spatial-temporal Reasoning 5 Oct 2023 mohamedaghzal/llms-as-path-planners/gpt-4-path-planning/src/evaluate.py 806fb301720451ec ran fingerprinted no licence file found · pointer only
Coloring the Blank Slate: Pre-training Imparts a Hierarchical Inductive Bias to Sequence-to-sequence Models 17 Mar 2022 sebschu/multilingual-transformations/models/metrics.py 66552297bbb6cd38 ran · honoured contract MIT (permissive)
Scale Efficiently: Insights from Pre-training and Fine-tuning Transformers 22 Sep 2021 aaronmueller/emergent-syntax/models/metrics.py 66552297bbb6cd38 ran · honoured contract MIT (permissive)
Quasar: Datasets for Question Answering by Search and Reading 12 Jul 2017 bdhingra/quasar/metric.py 8c2b5b40e8ea29f0 ran · violated contract fingerprinted BSD-2-Clause (permissive)
arXiv:2023.findings-emnlp.221 RshNk73/PistaQ-SREQA/PistaQ/triplet_extraction_NN_coref_rule_block.py fec01a8869724531 unverified MIT (permissive)

This site shows no code text; each File cell links to the file on GitHub at the repository's current default branch, which may have changed since the harvest. "Pointer only" means Syntology does not serve that copy's text, for one of four reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; or the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar). Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence cell for the reason. Per-sample records for a paper are on its paper page under "Code Syntology ran".

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections