| The Embedder's Dilemma: LLMs Are Better, but at What Cost? added by Syntology |
2026-08 (from id) |
embeddings-benchmark/embedders-dilemma/llm_judge/evaluators/llm_rag_evaluator.py 2d6aa73765f8c641 |
ran
fingerprinted |
Apache-2.0 (permissive) |
| Prompt Embedding Probes (PEP): Hallucination Detection in LLMs from Hidden States added by Syntology |
2026-08 (from id) |
zazamrykh/internal_probing/src/dataset/squad_eval.py aa6bc32d9c17a2f1 |
ran · our draft was wrong
fingerprinted |
MIT (permissive) |
| ReFact: Adaptive Fact Restatement for Compact and Faithful Chain-of-Thought Reasoning added by Syntology |
2026-07 (from id) |
NEUIR/REFACT/verl/verl/utils/reward_score/evdience_reward.py ef36c60282378811 |
ran · our draft was wrong
|
MIT (permissive) |
| OmniRetrieval: Unified Retrieval across Heterogeneous Knowledge Sources added by Syntology |
2026-05 (from id) |
JinheonBaek/OmniRetrieval/src/evaluation/metrics.py aa6bc32d9c17a2f1 |
ran · our draft was wrong
fingerprinted |
MIT (permissive) |
| Foundational Large Language Models for Materials Research |
12 Dec 2024 |
M3RG-IITD/llamat/src/Kshot-val.py aa6bc32d9c17a2f1 |
ran · our draft was wrong
fingerprinted |
MIT (permissive) |
| SiReRAG: Indexing Similar and Related Information for Multihop Reasoning |
9 Dec 2024 |
SalesforceAIResearch/SiReRAG/evaluate_musique.py aa6bc32d9c17a2f1 |
ran · our draft was wrong
fingerprinted |
no licence file found · pointer only |
| Synthetic Knowledge Ingestion: Towards Knowledge Refinement and Injection for Enhancing Large Language Models |
12 Oct 2024 |
intuit-ai-research/knowledge-infused-ai/synthetic-knowledge-ingestion/finetuning/ft_llama_factory.py aa6bc32d9c17a2f1 |
ran · our draft was wrong
fingerprinted |
Apache-2.0 (permissive) |
| A is for Absorption: Studying Feature Splitting and Absorption in Sparse Autoencoders |
22 Sep 2024 |
lasr-spelling/sae-spelling/sae_spelling/vocab.py 927eb86571fdf5f4 |
ran
|
MIT (permissive) |
| A Language Model's Guide Through Latent Space |
22 Feb 2024 |
dvruette/concept-guidance/concept_guidance/activations.py b168d5fa90d9b20d |
ran
|
MIT (permissive) |
| Towards Efficient Methods in Medical Question Answering using Knowledge Graph Embeddings |
15 Jan 2024 |
saptarshi059/cdqa-project/covid_qa_baseline.py aa6bc32d9c17a2f1 |
ran · our draft was wrong
fingerprinted |
no licence file found · pointer only |
| Towards Robust Temporal Reasoning of Large Language Models via a Multi-Hop QA Dataset and Pseudo-Instruction Tuning |
16 Nov 2023 |
nusnlp/complex-tr/prompt_experiment/sem_metric/evaluate.py 72ae17e5ad61f6cb |
ran
fingerprinted |
no licence file found · pointer only |
| Diversify Question Generation with Retrieval-Augmented Style Transfer |
23 Oct 2023 |
gouqi666/RAST/eval_squad.py 011d5cd744886e9d |
ran
fingerprinted |
no licence file found · pointer only |
| Knowledge-Augmented Language Model Verification |
19 Oct 2023 |
jinheonbaek/kalmv/metrics.py aa6bc32d9c17a2f1 |
ran · our draft was wrong
fingerprinted |
no licence file found · pointer only |
| Knowledge-Augmented Language Model Verification |
19 Oct 2023 |
JinheonBaek/KALMV/models/verifiers.py a2c23eaf23140be2 |
ran · our draft was wrong
fingerprinted |
no licence file found · pointer only |
| MenatQA: A New Dataset for Testing the Temporal Comprehension and Reasoning Abilities of Large Language Models |
8 Oct 2023 |
weiyifan1023/MenatQA/src/utils.py 575722a6543d189e |
ran
fingerprinted |
no licence file found · pointer only |
| RECOMP: Improving Retrieval-Augmented LMs with Compression and Selective Augmentation |
6 Oct 2023 |
carriex/recomp/eval_utils.py 496046a8354a8130 |
ran
fingerprinted |
MIT (permissive) |
| $\rm SP^3$: Enhancing Structured Pruning via PCA Projection |
31 Aug 2023 |
hyx1999/sp3/bert/metric/squad_v2.py 72ae17e5ad61f6cb |
ran
fingerprinted |
no licence file found · pointer only |
| End-to-End Beam Retrieval for Multi-Hop Question Answering |
17 Aug 2023 |
canghongjian/beam_retriever/gpt_turbo_exp.py 8a4f13df2795176e |
ran
fingerprinted |
Apache-2.0 (permissive) |
| Open Data on GitHub: Unlocking the Potential of AI |
9 Jun 2023 |
rajpurkar/SQuAD-explorer/evaluate-v2.0.py aa6bc32d9c17a2f1 |
ran · our draft was wrong
fingerprinted |
MIT (permissive) |
| Pointwise Mutual Information Based Metric and Decoding Strategy for Faithful Generation in Document Grounded Dialogs |
20 May 2023 |
ynandwan/pmi-faith/faithfulness-metrics/src/compute_faithfulness_api.py 9c6cb7a5a08fbe5d |
unverified |
Apache-2.0 (permissive) |
| Knowledge Card: Filling LLMs' Knowledge Gaps with Plug-in Specialized Language Models |
17 May 2023 |
bunsenfeng/knowledge_card/eval_datasets/MidtermQA/odqa_utils.py 496046a8354a8130 |
ran
fingerprinted |
MIT (permissive) |
| Phrase Retrieval Learns Passage Retrieval, Too |
16 Sep 2021 |
princeton-nlp/DensePhrases/densephrases/utils/squad_metrics.py aa6bc32d9c17a2f1 |
ran · our draft was wrong
fingerprinted |
Apache-2.0 (permissive) |
| A Dataset for Answering Time-Sensitive Questions |
13 Aug 2021 |
wenhuchen/time-sensitive-qa/utils.py 575722a6543d189e |
ran
fingerprinted |
BSD-3-Clause (permissive) |
| Ethical-Advice Taker: Do Language Models Understand Natural Language Interventions? |
2 Jun 2021 |
allenai/ethical-interventions/mutils.py db2b74b069046e20 |
unverified |
Apache-2.0 (permissive) |
| Equilibrium and non-Equilibrium regimes in the learning of Restricted Boltzmann Machines |
28 May 2021 |
AurelienDecelle/TorchRBM/rbm/fasta_utils.py 7eff798ee21e285c |
unverified |
MIT (permissive) |
| Learning to Perturb Word Embeddings for Out-of-distribution QA |
6 May 2021 |
seanie12/SWEP/squad_metrics.py aa6bc32d9c17a2f1 |
ran · our draft was wrong
fingerprinted |
MIT (permissive) |
| Annotating and Modeling Fine-grained Factuality in Summarization |
9 Apr 2021 |
tagoyal/factuality-datasets/evaluate_generated_outputs.py 702775d840e23942 |
unverified |
no licence file found · pointer only |
| Towards Interpreting BERT for Reading Comprehension Based QA |
18 Oct 2020 |
identical code first harvested elsewhere aa6bc32d9c17a2f1 |
ran · our draft was wrong
fingerprinted |
licence of this copy not recorded |
| Open-Domain Question Answering Goes Conversational via Question Rewriting |
10 Oct 2020 |
apple/ml-qrecc/utils/evaluate_qa.py 119c6dab40b4b162 |
unverified |
Apache-2.0 (permissive) |
| The Depth-to-Width Interplay in Self-Attention |
22 Jun 2020 |
uf-hobi-informatics-lab/GatorTron/finetuning/qa/evaluate-squad-v2.0.py aa6bc32d9c17a2f1 |
ran · our draft was wrong
fingerprinted |
MIT (permissive) |
| Revisiting Pre-Trained Models for Chinese Natural Language Processing |
29 Apr 2020 |
ymcui/Chinese-PreTrained-XLNet/src/squad_utils.py aa6bc32d9c17a2f1 |
ran · our draft was wrong
fingerprinted |
Apache-2.0 (permissive) |
| HybridQA: A Dataset of Multi-Hop Question Answering over Tabular and Textual Data |
15 Apr 2020 |
identical code first harvested elsewhere aa6bc32d9c17a2f1 |
ran · our draft was wrong
fingerprinted |
licence of this copy not recorded |
| Linking artificial and human neural representations of language |
2 Oct 2019 |
hans/nn-decoding/bin/eval_squad.py aa6bc32d9c17a2f1 |
ran · our draft was wrong
fingerprinted |
MIT (permissive) |
| Well-Read Students Learn Better: On the Importance of Pre-training Compact Models |
23 Aug 2019 |
somiltg/bert/evaluate-v2.0.py aa6bc32d9c17a2f1 |
ran · our draft was wrong
fingerprinted |
Apache-2.0 (permissive) |
| End-to-End Open-Domain Question Answering with BERTserini |
5 Feb 2019 |
rsvp-ai/bertserini/bertserini/utils/utils_squad_metrics.py aa6bc32d9c17a2f1 |
ran · our draft was wrong
fingerprinted |
Apache-2.0 (permissive) |
| BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding |
11 Oct 2018 |
Zehui127/SQUAD_BERT/SQUAD/evaluate-v2.0.py aa6bc32d9c17a2f1 |
ran · our draft was wrong
fingerprinted |
Apache-2.0 (permissive) |
| arXiv:aaai_16733 |
|
rajammanabrolu/WorldGeneration/neural-based/KG-extraction/utils_squad_evaluate.py aa6bc32d9c17a2f1 |
ran · our draft was wrong
fingerprinted |
MIT (permissive) |
| arXiv:2024.findings-emnlp.365 |
|
UKPLab/m2qa/Experiments/M2QA_Metric/m2qa_metric.py c74510c72823459a |
unverified |
Apache-2.0 (permissive) |
| arXiv:2023.findings-eacl.134 |
|
UniversalPropositions/PriMeSRL-Eval/src/proposed/conversion.py d0749cdadb55fd4f |
unverified |
Apache-2.0 (permissive) |
| arXiv:2023.emnlp-main.803 |
|
yisunlp/Anti-CF/utils/metrics.py aa6bc32d9c17a2f1 |
ran · our draft was wrong
fingerprinted |
MIT (permissive) |
| arXiv:2022.findings-emnlp.48 |
|
souvikdgp16/FADE/datasets/calculate_unigram_probability.py 0af007f9a8c6b6db |
unverified |
MIT (permissive) |