Type prediction

Benchmarks archive 2025-07-28

3 leaderboard tables shown for this task, 3 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

2 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

30 shown of 44 papers with code (96 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
  11 Oct 2018 534 repositories listed Syntology ran 204 of 659 samples · 455 unverified · 149 pointer-only (licence)
  We introduce a new language representation model called BERT, which stands for Bidirectional Encoder Representations from Transformers.
• RoBERTa: A Robustly Optimized BERT Pretraining Approach
  26 Jul 2019 67 repositories listed Syntology ran 22 of 48 samples · 26 unverified · 23 pointer-only (licence)
  Language model pretraining has led to significant performance gains but careful comparison between different approaches is challenging.
• You Only Look at Screens: Multimodal Chain-of-Action Agents
  20 Sep 2023 7 repositories listed Syntology ran 1 of 2 samples · 1 unverified
  Autonomous graphical user interface (GUI) agents aim to facilitate task automation by interacting with the user interface without manual intervention.
• CoCo-Agent: A Comprehensive Cognitive MLLM Agent for Smartphone GUI Automation
  19 Feb 2024 2 repositories listed Syntology ran 4 of 4 samples · 0 unverified · 4 pointer-only (licence)
  We propose a Comprehensive Cognitive LLM Agent, CoCo-Agent, with two novel approaches, comprehensive environment perception (CEP) and conditional action prediction (CAP), to systematically improve the GUI automation…
• Zero-shot Entity Linking with Less Data
  1 Jul 2022 2 repositories listed
  Interestingly, we discovered that BLINK exhibits diminishing returns, i.
• Neural Software Analysis
  16 Nov 2020 2 repositories listed
  The resulting tools complement and outperform traditional program analyses, and are used in industrial practice.
• UniPTMs: The First Unified Multi-type PTM Site Prediction Model via Master-Slave Architecture-Based Multi-Stage Fusion Strategy and Hierarchical Contrastive Loss
  5 Jun 2025 1 repository listed
  As a core mechanism of epigenetic regulation in eukaryotes, protein post-translational modifications (PTMs) require precise prediction to decipher dynamic life activity networks.
• Graph Structure Learning for Tumor Microenvironment with Cell Type Annotation from non-spatial scRNA-seq data
  4 Feb 2025 1 repository listed
  The exploration of cellular heterogeneity within the tumor microenvironment (TME) via single-cell RNA sequencing (scRNA-seq) is essential for understanding cancer progression and response to therapy.
• Detecting Side Effects of Adverse Drug Reactions Through Drug-Drug Interactions Using Graph Neural Networks and Self-Supervised Learning
  31 May 2024 1 repository listed
  At present, no standard method to detect such adverse drug reactions exists until otherwise reported by patients after the drug is released to the market.
• GlycanML: A Multi-Task and Multi-Structure Benchmark for Glycan Machine Learning
  25 May 2024 1 repository listed Syntology ran 2 of 2 samples · 0 unverified
  Also, we evaluate how taxonomy prediction can boost other three function prediction tasks by MTL.
• SMURF-THP: Score Matching-based UnceRtainty quantiFication for Transformer Hawkes Process
  25 Oct 2023 1 repository listed
  We conduct extensive experiments in both event type prediction and uncertainty quantification of arrival time.
• Learning Type Inference for Enhanced Dataflow Analysis
  1 Oct 2023 1 repository listed
  Comparing our approach against recent neural type inference systems, our model outperforms the current state-of-the-art by 7.
• Type Prediction With Program Decomposition and Fill-in-the-Type Training
  25 May 2023 1 repository listed
  TypeScript and Python are two programming languages that support optional type annotations, which are useful but tedious to introduce and maintain.
• TypeT5: Seq2seq Type Inference using Static Analysis
  16 Mar 2023 1 repository listed Syntology ran 0 of 7 samples · 7 unverified
  There has been growing interest in automatically predicting missing type annotations in programs written in Python and JavaScript.
• Recall, Expand and Multi-Candidate Cross-Encode: Fast and Accurate Ultra-Fine Entity Typing
  18 Dec 2022 1 repository listed
  We also found MCCE is very effective in fine-grained (130 types) and coarse-grained (9 types) entity typing.
• Leveraging Wikidata's edit history in knowledge graph refinement tasks
  27 Oct 2022 1 repository listed
  A number of solutions have been proposed to that end, ranging from rule-based approaches to the use of probabilistic methods, but there is an element that has not been considered yet: the edit history of the graph.
• ManyTypes4TypeScript: A Comprehensive TypeScript Dataset for Sequence-Based Type Inference
  17 Oct 2022 1 repository listed
  In this paper, we present ManyTypes4TypeScript, a very large corpus for training and evaluating machine-learning models for sequence-based type inference in TypeScript.
• PhaTYP: Predicting the lifestyle for bacteriophages using BERT
  20 Jun 2022 1 repository listed
  In this work, we develop PhaTYP (Phage TYPe prediction tool) to improve the accuracy of lifestyle prediction on short contigs.
• Predicting Issue Types with seBERT
  3 May 2022 1 repository listed
  Pre-trained transformer models are the current state-of-the-art for natural language models processing.
• Beyond Duplicates: Towards Understanding and Predicting Link Types in Issue Tracking Systems
  27 Apr 2022 1 repository listed
  For instance, Duplication links tend to represent simpler issue graphs often with two components and Composition links present the highest amount of hierarchical tree structures (97.
• AiTLAS: Artificial Intelligence Toolbox for Earth Observation
  21 Jan 2022 1 repository listed
  The AiTLAS toolbox (Artificial Intelligence Toolbox for Earth Observation) includes state-of-the-art machine learning methods for exploratory and predictive analysis of satellite imagery as well as repository of…
• Point-of-Interest Type Prediction using Text and Images
  1 Sep 2021 1 repository listed
  Point-of-interest (POI) type prediction is the task of inferring the type of a place from where a social media post was shared.
• Fine-grained General Entity Typing in German using GermaNet
  1 Jun 2021 1 repository listed
  We use a German WordNet equivalent, GermaNet, to automatically generate training data for German general entity typing.
• Text2Chart: A Multi-Staged Chart Generator from Natural Language Text
  9 Apr 2021 1 repository listed
  Firstly, it identifies the axis elements of a chart from the given text known as x and y entities.
• Annotating Columns with Pre-trained Language Models
  5 Apr 2021 1 repository listed Syntology ran 0 of 3 samples · 3 unverified
  Inferring meta information about tables, such as column headers or relationships between columns, is an active research topic in data management as we find many tables are missing some of this information.
• Bio-JOIE: Joint Representation Learning of Biological Knowledge Bases
  7 Mar 2021 1 repository listed
  Leveraging a wide-range of biological knowledge, such as gene ontology and protein-protein interaction (PPI) networks from other closely related species presents a vital approach to infer the molecular impact of a new…
• TCN: Table Convolutional Network for Web Table Interpretation
  17 Feb 2021 1 repository listed
  Existing work linearize table cells and heavily rely on modifying deep language models such as BERT which only captures related cells information in the same table.
• Type4Py: Practical Deep Similarity Learning-Based Type Inference for Python
  12 Jan 2021 1 repository listed
  It learns to discriminate between similar and dissimilar types in a high-dimensional space, which results in clusters of types.
• SeMantic AnsweR Type prediction task (SMART) at ISWC 2020 Semantic Web Challenge
  1 Dec 2020 1 repository listed
  Each year the International Semantic Web Conference accepts a set of Semantic Web Challenges to establish competitions that will advance the state of the art solutions in any given problem domain.
• On the Complementary Nature of Knowledge Graph Embedding, Fine Grain Entity Types, and Language Modeling
  12 Oct 2020 1 repository listed
  We demonstrate the complementary natures of neural knowledge graph embedding, fine-grain entity type prediction, and neural language modeling.

Syntology lines on 7 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.