Papers › Declarative Experimentation in Information Retrieval using PyTerrier

Declarative Experimentation in Information Retrieval using PyTerrier

28 Jul 2020arXiv:2007.14271archive 2025-07-28

Craig Macdonald, Nicola Tonellotto

The advent of deep machine learning platforms such as Tensorflow and Pytorch, developed in expressive high-level languages such as Python, have allowed more expressive representations of deep neural network architectures. We argue that such a powerful formalism is missing in information retrieval (IR), and propose a framework called PyTerrier that allows advanced retrieval pipelines to be expressed, and evaluated, in a declarative manner close to their conceptual design. Like the aforementioned frameworks that compile deep learning experiments into primitive GPU operations, our framework targets IR platforms as backends in order to execute and evaluate retrieval pipelines. Further, we can automatically optimise the retrieval pipelines to increase their efficiency to suite a particular IR platform backend. Our experiments, conducted on TREC Robust and ClueWeb09 test collections, demonstrate the efficiency benefits of these optimisations for retrieval pipelines involving both the Anserini and Terrier IR platforms.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

terrier-org/pyterrier officialmentioned in papermentioned on GitHub report
cmacdonald/pyt_jpq mentioned on GitHubpytorch report
cmacdonald/pyterrier_colbert mentioned on GitHubpytorchnot reachable when probed 2026-09-17 — repositories for recent papers often appear after camera-ready report
parry-parry/pyterrier_t5 mentioned on GitHubpytorch report
terrierteam/pyterrier_ance mentioned on GitHubpytorch report
terrierteam/pyterrier_deepct mentioned on GitHubtf report
terrierteam/pyterrier_doc2query mentioned on GitHubpytorch report
terrierteam/pyterrier_t5 mentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Information RetrievalRetrieval

1 archive task tag without a task page not shown.

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections