Papers › BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova
We introduce a new language representation model called BERT, which stands for Bidirectional Encoder Representations from Transformers. Unlike recent language representation models, BERT is designed to pre-train deep bidirectional representations from unlabeled text by jointly conditioning on both left and right context in all layers. As a result, the pre-trained BERT model can be fine-tuned with just one additional output layer to create state-of-the-art models for a wide range of tasks, such as question answering and language inference, without substantial task-specific architecture modifications. BERT is conceptually simple and empirically powerful. It obtains new state-of-the-art results on eleven natural language processing tasks, including pushing the GLUE score to 80.5% (7.7% point absolute improvement), MultiNLI accuracy to 86.7% (4.6% absolute improvement), SQuAD v1.1 question answering Test F1 to 93.2 (1.5 point absolute improvement) and SQuAD v2.0 Test F1 to 83.1 (5.1 point absolute improvement).
In Syntology View this paper on Syntology, its page in Syntology's graph. That page adds which of its functions are also present in other papers' code Syntology holds, with dates, and its dated run record as JSON and a README badge. It also lists the repositories linked to the paper, the abstract and the calls for agents.
Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
For agents, on Syntology's MCP service (how to connect):
get_harvested_code_for_paper(arxiv_id="1810.04805")get_code(code_sha256="…")with a sample'scode_sha256from the list belowget_citation_path(paper_1="1810.04805", paper_2="…")with another paper's arXiv id or titleget_concepts_for_paper(arxiv_id="1810.04805")
Code
No sample from the archive's official repository (google-research/bert) is linked to this paper; the 655 samples below come from 170 community repositories, and 4 more are identical to code Syntology harvested from another paper's repository. Syntology harvested code from google-research/bert for another paper.
google-research/bert: Syntology's graph links these samples to NapSS: Paragraph-level Medical Text Simplification via Narrative Prompting and... (arXiv:2302.05574; that paper's own run record: 17 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 1 honoured, 0 violated, 12 with no contract checked; 4 where Syntology's instrument failed) · 7 unverified); nothing checks that they implement this paper's method.
Syntology 659 code samples: 655 from 170 repositories linked to this paper, 4 identical to code harvested from another paper's repository. Across all 659: 300 ran (of which 75 constructed an object rather than computing a result; 234 with no instrument failure: 18 honoured, 5 violated, 211 with no contract checked; 66 where Syntology's instrument failed) · 359 unverified. Where Syntology's instrument failed: 54 where our contract draft was wrong; 12 where the contract check could not run; failures of Syntology's instrument, not of the code.
By repository: community (archive-listed): 655 samples from 170 repositories, 298 ran (232 with no instrument failure; 66 where Syntology's instrument failed); 4 identical to code first harvested elsewhere. The run record, sample by sample. “Ran” means executed on a synthesized input, not that the code is correct or reproduces the paper.
No sample is linked to this paper from 62 of its repositories that Syntology harvested for other papers:
- google-research/bert, official repository: harvested for another paper, listed under the repository
- Arthurizijar/Bert_Airport, community (archive-listed): harvested for another paper, listed under the repository
- ArvinZhuang/BiTAG, community (archive-listed): harvested for another paper, listed under the repository
- CVxTz/music_genre_classification, community (archive-listed): harvested for another paper, listed under the repository
- Chonwai/Learning_BERT, community (archive-listed): harvested for another paper, listed under the repository
- CyberZHG/keras-bert, community (archive-listed): harvested for another paper, listed under the repository
- Holldean/BERT-Pruning, community (archive-listed): harvested for another paper, listed under the repository
- IMPLabUniPr/UniParma-at-semeval-2021-task-5, community (archive-listed): harvested for another paper, listed under the repository
- MOHAMEDELDAKDOUKY/bert_adjusted, community (archive-listed): harvested for another paper, listed under the repository
- MalteHB/-l-ctra, community (archive-listed): harvested for another paper, listed under the repository
- Maz101/Bert, community (archive-listed): harvested for another paper, listed under the repository
- PaddlePaddle/models, community (archive-listed): harvested for another paper, listed under the repository
- ProsusAI/finBERT, community (archive-listed): harvested for another paper, listed under the repository
- SAP-samples/acl2019-commonsense, community (archive-listed): harvested for another paper, listed under the repository
- SAP-samples/acl2019-commonsense-reasoning, community (archive-listed): harvested for another paper, listed under the repository
- Sanyuan-Chen/RecAdam, community (archive-listed): harvested for another paper, listed under the repository
- SpikeKing/My-Bert, community (archive-listed): harvested for another paper, listed under the repository
- StoneGH/bert, community (archive-listed): harvested for another paper, listed under the repository
- Susheel-1999/Sentence_Similarity, community (archive-listed): harvested for another paper, listed under the repository
- TidalPaladin/neural-summarizer, community (archive-listed): harvested for another paper, listed under the repository
- TonyX19/bert_hyperpartisan, community (archive-listed): harvested for another paper, listed under the repository
- arkel23/PyTorch-Pretrained-ViT, community (archive-listed): harvested for 2 other papers, listed under the repository
- bit-ml/anoshift, community (archive-listed): harvested for another paper, listed under the repository
- coronazap/bert_client, community (archive-listed): harvested for another paper, listed under the repository
- davidbellamy/labrador, community (archive-listed): harvested for another paper, listed under the repository
- dispink/xpt, community (archive-listed): harvested for another paper, listed under the repository
- geondopark/ckd, community (archive-listed): harvested for another paper, listed under the repository
- google/seqio, community (archive-listed): harvested for another paper, listed under the repository
- halo090770/bert, community (archive-listed): harvested for another paper, listed under the repository
- helboukkouri/character-bert, community (archive-listed): harvested for another paper, listed under the repository
- huggingface/transformers, community (archive-listed): harvested for 4 other papers, listed under the repository
- johnr0/TaleBrush-backend, community (archive-listed): harvested for another paper, listed under the repository
- knuddj1/op_text, community (archive-listed): harvested for another paper, listed under the repository
- kpe/bert-for-tf2, community (archive-listed): harvested for another paper, listed under the repository
- lukemelas/PyTorch-Pretrained-ViT, community (archive-listed): harvested for 2 other papers, listed under the repository
- okanvk/ENELPI---Soru-Cevap-Sistemi, community (archive-listed): harvested for another paper, listed under the repository
- paolanu/BERT_epitope, community (archive-listed): harvested for another paper, listed under the repository
- pisalore/roberta_results, community (archive-listed): harvested for another paper, listed under the repository
- reppy4620/Dialog, community (archive-listed): harvested for another paper, listed under the repository
- rohanshad/cmr_transformer, community (archive-listed): harvested for another paper, listed under the repository
- salesforce/GeDi, community (archive-listed): harvested for another paper, listed under the repository
- samwisegamjeee/pytorch-transformers, community (archive-listed): harvested for another paper, listed under the repository
- smarton-empower/smarton-ai, community (archive-listed): harvested for another paper, listed under the repository
- somiltg/bert, community (archive-listed): harvested for another paper, listed under the repository
- sunyilgdx/prompts4keras, community (archive-listed): harvested for another paper, listed under the repository
- tensorflow/models, community (archive-listed): harvested for 4 other papers, listed under the repository
- the-Quert/iNLPfun, community (archive-listed): harvested for another paper, listed under the repository
- thu-keg/omnievent, community (archive-listed): harvested for another paper, listed under the repository
- utterworks/fast-bert, community (archive-listed): harvested for another paper, listed under the repository
- volcengine/vegiantmodel, community (archive-listed): harvested for another paper, listed under the repository
- wangcongcong123/ttt, community (archive-listed): harvested for another paper, listed under the repository
- zaradana/Fast_BERT, community (archive-listed): harvested for 2 other papers, listed under the repository
- MS-P3/code5, community (archive-listed): harvested for another paper, listed under the repository
- PaddlePaddle/PaddleNLP, community (archive-listed): harvested for another paper, listed under the repository
- abhaskumarsinha/Keras-implementation-of-Transformer-Architecture, community (archive-listed): harvested for another paper, listed under the repository
- alibaba/EasyNLP, community (archive-listed): harvested for another paper, listed under the repository
- dmlc/gluon-nlp, community (archive-listed): harvested for another paper, listed under the repository
- labmlai/annotated_deep_learning_paper_implementations, community (archive-listed): harvested for 15 other papers, listed under the repository
- lvyufeng/bert4ms, community (archive-listed): harvested for another paper, listed under the repository
- mindspore-ai/models, community (archive-listed): harvested for another paper, listed under the repository
- xiuyu0000/tutorials, community (archive-listed): harvested for another paper, listed under the repository
- yoshitomo-matsubara/torchdistill, community (archive-listed): harvested for 6 other papers, listed under the repository
Levels written between 2026-09-22 and 2026-09-26 (UTC): the dates Syntology's graph wrote each sample's verification level, not when the code executed. 2 of the 300 samples that ran have no recorded date.
534 repositories listed; official and paper-mentioned ones first.
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
A paper named beside a repository with no sample linked to this paper is shown with that paper's own run record, not this paper's: “ran” means executed on a synthesized input, not that the code is correct, and “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Papers are listed in arXiv-id order, at most three per repository.
Code Syntology ran Syntology
659 samples harvested: 300 ran (of which 75 constructed an object rather than computing a result; 234 with no instrument failure: 18 honoured, 5 violated, 211 with no contract checked; 66 where Syntology's instrument failed) · 359 unverified. “Where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. That date is not when the samples ran.
Licence: 164 of the 659 samples are pointer only, meaning Syntology does not serve that copy's text. For 15 of them, this paper's copy is under a permissive licence and cleared, but the stored copy of the same code that Syntology serves is not; the licence label's tooltip gives Syntology's recorded reason. This page shows no code text for any sample; each one links to its file in the repository.
Harvested from 170 repositories linked to this paper, official or community; the list below is grouped by repository, each group headed by its name and what it is to the paper. 2 samples whose link to this paper records no repository are listed under one of this paper's own repositories, because identical code was harvested from it for another paper. 4 samples are listed last, in a group without a repository. “Ran” means the sample executed on a synthesized input. It does not mean the output is correct, and nothing here reproduces the paper's results. A line beginning “fixture:” under a sample that ran gives the arguments Syntology's fixture called the sample with, each as name:type/rank/element kind (? where none was recorded), and the type of what the fixture's run returned, exactly as the harness recorded them; the arguments and the returned type were recorded by two separate runs of the same fixture. No output value is shown, and a returned type says nothing about whether the output was right. “Level recorded” gives the UTC date when Syntology's graph wrote the sample's verification level, not when the code executed; where the level was written before Syntology's graph kept that date, the row says “level recorded, date not recorded”. For 24 samples that ran, the graph records a signature this page does not show: for a class the fixture built without calling, the harness called the object with inputs it made up itself, so the recorded signature is the harness's probe, not the fixture's arguments. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself. “Our draft was wrong” and “the contract check could not run” are failures of Syntology's instrument, not of the code: the sample ran on Syntology's synthesized input, and then the drafted contract did not describe it, or the check itself raised an error (RAISES), lacked a dependency (DEP_MISSING) or ran out of time (TIMEOUT); hover the label for which. A metamorphic tier, where shown, is evidence of the output's shape, not that the sample implements the method.
Each sample ends with its code_sha256. A sample's code_sha256 is Syntology's identity for that exact code. It is printed in full (16 hexadecimal characters for every sample in this build), and get_code(code_sha256="…") takes it exactly as printed. An agent calls it on Syntology's MCP service (how to connect); click an identity to copy that call.
Repository labels, per sample. official repository: The archive marks this repository official for the paper. named in the paper: The archive records that the paper mentions this repository; it is not marked official. community (archive-listed): In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper. found in paper text by Syntology: Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted. community: Not in the archive's code links for this paper; a community repository Syntology harvested. Samples are grouped by repository: a repository marked official first, then by how directly the repository is tied to the paper, then in the archive's order; never by how many ran. Licence labels name the repository's licence as recorded at harvest. “Pointer only” means Syntology does not serve that copy's text, for one of six reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar); this paper's copy was not located, so its licence is not recorded; or this paper's copy is cleared, but the stored copy of the same code that Syntology serves is not. Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence label for the reason. File links open the file on GitHub at the default branch, which may have changed since the harvest.
A function or class name links to its page when the name occurs in the harvested code of at least 5 papers; the name is a string, not an identity. A census tag appears when Syntology's census ran implementations with that name on one shared input per bucket: it gives how many were compared, from how many papers, and how many distinct outputs they produced, and names this sample's bucket when this sample was one of them.
1923fc05163d207d · report
fixture: signature text:str/0/str · returned str · level recorded 2026-09-22 b24b3b9c700da839 · report
fixture: signature values:list/1/float · returned Feature · level recorded 2026-09-25 dd3ef48a15aec0cd · report
fixture: signature values:list/1/int · returned Feature · level recorded 2026-09-25 47a3c792cebb6603 · report
fixture: signature features:list/1/Feature, seq_length:int/0/int · returned function · level recorded 2026-09-25 0e5615f8994003cf · report
fixture: signature text:str/0/str · returned str · level recorded 2026-09-26 d265475b00a0bd2a · report
fixture: signature x_data:ndarray/2/float, y_data:ndarray/1/int, validation_size:float/0/float, test_size:float/0/float, shuffle:bool/0/bool · returned tuple · level recorded 2026-09-26 50958618b65e514e · report
ff83ccc8b0b6462d · report
11c6fa170176d70c · report
fixture: returned PRModule · level recorded 2026-09-22 946cb85549525f87 · report
fixture: returned PTSModule · level recorded 2026-09-22 8dc5a87ccb14f5a3 · report
fixture: returned SSCModule · level recorded 2026-09-22 539b7f6e38fc9786 · report
fixture: returned int · level recorded 2026-09-24 cc62602c7903b248 · report
800be52d2ae3bfbf · report
37763f7651473aeb · report
fixture: returned generate_embedding · level recorded 2026-09-22 1b46c9ce24fc6db3 · report
census: 43 implementations from 74 papers, 6 distinct outputs on one shared input modeling.py ran · honoured contract fingerprinted Apache-2.0 (permissive) ·
d08f324f950148de · report
fixture: signature x:EagerTensor/2/float · returned EagerTensor · level recorded 2026-09-22 5842ee67106321d6 · report
fixture: signature activation_string:str/0/str · returned function · level recorded 2026-09-22 d16dcfaecf4647ad · report
ecf19688a7eb0d04 · report
fe0428bc0b127744 · report
9c69503daf39b4c9 · report
e353d671edbdf34f · report
a3faf4d662ac37da · report
fixture: signature model:callable/0/?, tokenizer:callable/0/?, text:str/0/str, topk:int/0/int · returned list · level recorded 2026-09-22 5da4c1bd74744fd0 · report
fixture: signature all_tokens:list/1/str, max_vocab_size:int/0/int · returned tuple · level recorded 2026-09-26 280790eecc52aeb7 · report
fixture: signature data:dict/0/?, embMode:str/0/str, numLayers:int/0/int · returned tuple · level recorded 2026-09-26 1cd84ed3b71e0fe9 · report
fixture: signature numLayers:int/0/int, jsonObject:dict/0/? · returned list · level recorded 2026-09-26 084c2d3f750ce4a3 · report
fixture: signature review:str/0/str · returned str · level recorded 2026-09-26 9acaf439c305b756 · report
fixture: signature review:str/0/str · returned list · level recorded 2026-09-26 50bbc8332a5c0e0b · report
fixture: signature lines:list/1/str · returned tuple · level recorded 2026-09-26 99722032c6491d59 · report
fixture: signature tokens_data:list/1/list, token2id:dict/0/? · returned list · level recorded 2026-09-26 42584320d6d813de · report
fixture: signature tokens:list/1/str, token2id:dict/0/? · returned list · level recorded 2026-09-26 c3c638ac738a7ecf · report
05b9987e3ccdec7e · report
7c9cfa7d3338fc45 · report
0f2b876d0df17a8b · report
fixture: returned BertConfig · level recorded 2026-09-22 fe52ecd17f753018 · report
fixture: returned BertIntermediate · level recorded 2026-09-22 8a705a46d62ae2db · report
fixture: signature url_or_filename:str/0/str, cache_dir:str/0/str · returned str · level recorded 2026-09-22 dade35e703d97ab9 · report
fixture: signature func:callable/0/? · returned function · level recorded 2026-09-22 7bbb022fe9e684b4 · report
b4ad6a57351fa7ba · report
c499a33e67b2478d · report
f664b844f4d571db · report
8a6cfedeee721825 · report
dd8b7fc41b86abb6 · report
fixture: signature file:str/0/str · returned list · level recorded 2026-09-26 ef47b227c080ca7a · report
fixture: signature text:str/0/str · returned str · level recorded 2026-09-26 b6aaa4f7c73f3d7e · report
fixture: signature text:str/0/str · returned str · level recorded 2026-09-26 97438b663cee62b4 · report
a64f2359d969d7c9 · report
fixture: returned BasicTokenizer · level recorded 2026-09-22 e8e1b2b21151ac96 · report
fixture: returned WordpieceTokenizer · level recorded 2026-09-22 d0e80220bcbf4ae0 · report
fixture: signature vocab_file:str/0/str · returned OrderedDict · level recorded 2026-09-22 337e4831268a4465 · report
18cae5cbe3552c86 · report
fixture: signature examples:list/1/Example, max_seq_length:int/0/int, tokenizer:SimpleTokenizer/0/? · returned list · level recorded 2026-09-26 63b06d1b6c72a14c · report
fixture: returned BertConfig · level recorded 2026-09-22 622c5fc2c7a23655 · report
fixture: returned BertIntermediate · level recorded 2026-09-22 b62d4fe9e831d295 · report
fixture: returned BertSelfAttention · level recorded 2026-09-22 census: 43 implementations from 74 papers, 6 distinct outputs on one shared input this sample: bucket 1 of 1, arg 1: rank 2, kind float, dtype float32 relogic/logickit/inference/modeling.py ran · honoured contract fingerprinted MIT (permissive) ·
90e5e96897d48ebb · report
fixture: signature x:Tensor/2/float · returned Tensor · level recorded 2026-09-22 f4f4879066931500 · report
fixture: signature layer:callable/0/?, index:Tensor/1/int, dim:int/0/int · returned Linear · level recorded 2026-09-22 f5bafea439ee7a6d · report
83ba0b7e85109bc1 · report
6592c17758687a36 · report
aca0ed0d9602bae6 · report
dc676111545d7cd3 · report
79c6bbbf312efc13 · report
acbbe819a7927233 · report
da24676d8c44235e · report
5a70204480cee7ee · report
0024def7e853c898 · report
fixture: signature word2pred:ndarray/2/int, glove_model:MockGloveModel/0/?, fasttext_model:MockFastTextModel/0/?, bert_sucidal:callable/0/?, bert_sadness:callable/0/? · returned list · level recorded 2026-09-22 68e228e1a25b69ed · report
fixture: signature sen:str/0/str · returned str · level recorded 2026-09-22 bd4a102f50a58c35 · report
d48289b49ea0e641 · report
136139e549db31e2 · report
a3ac6c28547f1753 · report
40a5ea739723045e · report
fixture: signature x:Tensor/2/int, y:Tensor/2/int, seg_ids:Tensor/2/int, mask:Tensor/2/int · returned Tensor · level recorded 2026-09-24 d40960e250106082 · report
fixture: returned NoNewAttrs · level recorded 2026-09-22 3ef7972a27b2f8fa · report
fixture: signature wrapped_setatrr:callable/0/? · returned function · level recorded 2026-09-22 3d815ae093b291de · report
6d2298e39819682c · report
bd9da314f50f70c6 · report
4525f9e4207ffc06 · report
19a78bec56a43e0b · report
fixture: signature t:Tensor/2/float, device:str/0/str · returned Tensor · level recorded 2026-09-22 b8e9909c4cffb4a3 · report
fixture: returned BERTEmbedding · level recorded 2026-09-22 25583325a9dc3221 · report
fixture: returned SegmentEmbedding · level recorded 2026-09-22 19ed76f032cfa56a · report
fixture: returned TokenEmbedding · level recorded 2026-09-22 f105653fd006d566 · report
add3130b56c2aaa7 · report
0fc04590521d0f1c · report
4874ae2953f3aeab · report
fixture: signature text:str/0/str · returned str · level recorded 2026-09-26 4636d480c5444328 · report
fixture: signature result:MockDataset/0/? · returned tuple · level recorded 2026-09-26 641f3758575965e6 · report
fixture: signature result:tuple/1/Tensor · returned tuple · level recorded 2026-09-26 e4dbe9646176983b · report
fixture: signature text:str/0/str · returned str · level recorded 2026-09-24 85608a0993acae75 · report
e72e9af8cbe399de · report
d4c7c4553bc6c06f · report
cac113ca87b9d9f3 · report
fixture: signature preds:ndarray/1/int, labels:ndarray/1/int · returned dict · level recorded 2026-09-22 census: 8 implementations from 7 papers, 7 distinct outputs across 6 buckets, one shared input per bucket finetune/PyTorch/run_classifier_azureml.py ran · honoured contract fingerprinted MIT (permissive) ·
eb725d5794b15f6b · report
fixture: signature out:ndarray/2/float, labels:ndarray/1/int · returned int64 · level recorded 2026-09-22 d18ca5cc79f6a030 · report
fixture: signature x:int/0/int, initial_steps:int/0/int, target_steps:int/0/int, warmup:int/0/int · returned int · level recorded 2026-09-26 94379d9b86286b17 · report
fixture: signature examples:list/1/Example, label_list:list/1/str, max_seq_length:int/0/int, tokenizer:SimpleTokenizer/0/? · returned list · level recorded 2026-09-22 f6c275d6a18330a9 · report
fixture: signature prediction:str/0/str, ground_truth:str/0/str · returned bool · level recorded 2026-09-22 2112c433b9c6d343 · report
fixture: signature prediction:str/0/str, ground_truth:str/0/str · returned float · level recorded 2026-09-22 e0c5130b8a1fcaa9 · report
fixture: signature text:str/0/str · returned datetime · level recorded 2026-09-26 c6a80c065d2e4851 · report
fixture: signature s:str/0/str · returned str · level recorded 2026-09-22 7c152858416dd138 · report
fixture: signature named_params_optimizer:list/1/tuple, named_params_model:list/1/tuple, test_nan:bool/0/bool · returned bool · level recorded 2026-09-22 c58d57224530d17e · report
fixture: signature x:float/0/float, warmup:float/0/float · returned float · level recorded 2026-09-22 f07d0d8833d15b7b · report
f4c553806059cc5c · report
3c241ecfe3749a6d · report
3733dd581eb74a68 · report
64296a59e688d4dd · report
5e4f948271236a41 · report
fixture: signature s:str/0/str, span:tuple/1/int, mask_token:str/0/str · returned tuple · level recorded 2026-09-26 126fb5715f78751b · report
fixture: signature activation_string:str/0/str · returned function · level recorded 2026-09-22 f79554c02fe8a46e · report
b37500395497efb4 · report
ac6226dbdba0f5e3 · report
92ef7ef36a321f62 · report
5681f7dd9b6e3679 · report
fixture: signature activation_string:str/0/str · returned function · level recorded 2026-09-22 f648a4567745fd52 · report
a8b0e78302dc02d4 · report
census: 43 implementations from 74 papers, 6 distinct outputs on one shared input modeling.py unverified Apache-2.0 (permissive) ·
ecab128238ebf253 · report
4f87a173bcbfc6e5 · report
a3937a3e9b656cb7 · report
fixture: signature x:Tensor/2/int, segment_x:Tensor/2/int, mask:Tensor/2/int · returned Tensor · level recorded 2026-09-24 f2365adf361472b0 · report
fixture: signature x:Tensor/3/float, mask:Tensor/4/float · returned Tensor · level recorded 2026-09-22 da28e8ad6c6750a6 · report
fixture: signature x:Tensor/2/int, segment_x:Tensor/2/int · returned Tensor · level recorded 2026-09-22 64910f05f8cd9c7d · report
fixture: signature query:Tensor/3/float, key:Tensor/3/float, value:Tensor/3/float, mask:NoneType/0/? · returned Tensor · level recorded 2026-09-22 ef1cb1634a1b5c69 · report
fa0ddb048557dd4a · report
a058c7071e411484 · report
7bd54c667a7fb54d · report
fixture: signature input_string:str/0/str · returned int64 · level recorded 2026-09-26 fb518a8fa5849d2f · report
fixture: signature input_tensor:EagerTensor/2/float, dropout_prob:float/0/float · returned EagerTensor · level recorded 2026-09-22 61de2f8dfc7d014a · report
fixture: signature activation_string:str/0/str · returned function · level recorded 2026-09-22 4c33136de32333c9 · report
fixture: signature tensor:EagerTensor/2/float, expected_rank:int/0/int, name:str/0/str · returned list · level recorded 2026-09-22 c1c5de65dfedcf88 · report
01e4a365b28cda00 · report
62ba879682ced155 · report
a019ca35d0434118 · report
194a6562b994a2e1 · report
277b18bc7acee12c · report
census: 43 implementations from 74 papers, 6 distinct outputs on one shared input modeling.py unverified no licence file found · pointer only ·
71e7e82f26b8d902 · report
61cb05022cc82f2b · report
3cfa2e7b4d67e9ee · report
dbc9628a5ca3b1f5 · report
fc8285a0c6ac6166 · report
fixture: returned LabelSet · level recorded 2026-09-22 3d02134ab73b6e7b · report
e3eb406d12cc6ada · report
fixture: returned Bert · level recorded 2026-09-22 bb96b67490720a42 · report
f1d7e9fdcb42955e · report
aa6bc32d9c17a2f1 · report
fixture: signature s:str/0/str · returned list · level recorded 2026-09-22 e91c44f5680827e2 · report
fixture: signature dataset:list/1/dict · returned dict · level recorded 2026-09-22 6a96435eba311b08 · report
fixture: signature s:str/0/str · returned str · level recorded 2026-09-22 36fb38c1b2c56c3e · report
fixture: signature string:str/0/str · returned str · level recorded 2026-09-26 3429784883ed49da · report
fixture: returned BertDataset · level recorded 2026-09-22 a8d8657df9ba7457 · report
fixture: returned InputFeatures · level recorded 2026-09-22 e23a0e9f62822bae · report
fixture: signature examples:list/1/SimpleExample, label_list:list/1/str, max_seq_length:int/0/int, tokenizer:SimpleTokenizer/0/? · returned list · level recorded 2026-09-22 894f421d39f125cd · report
9d3541f3279b9ee3 · report
fixture: signature _id2label:dict/0/? · returned str · level recorded 2026-09-26 2f215e3ae75e7690 · report
fixture: signature index:int/0/int · returned str · level recorded 2026-09-26 6b299f9e659c4f93 · report
fixture: signature _input_lines:list/1/dict · returned list · level recorded 2026-09-26 84fe5ed188ad2616 · report
fixture: signature _input_lines:list/1/dict, _max_lines:NoneType/0/? · returned list · level recorded 2026-09-26 4715de39d0859675 · report
fixture: signature _input_lines:list/1/dict, _max_lines:NoneType/0/? · returned list · level recorded 2026-09-26 ac2ac4bdbe1b8269 · report
fixture: signature _evaluation_dict:dict/0/?, _rounded_decimals:int/0/int · returned dict · level recorded 2026-09-26 358e0635a43eb484 · report
fixture: signature annotation_classes:list/1/str, outputs:Tensor/3/float · returned list · level recorded 2026-09-26 8396c5967c3a2df6 · report
fixture: returned BertSelfAttention · level recorded 2026-09-22 1b86f515e6b9c99d · report
357e659d771ec7d5 · report
fixture: signature module:callable/0/? · returned NoneType · level recorded 2026-09-24 6f042d066efe5345 · report
fixture: signature hidden_states:Tensor/2/float · returned Tensor · level recorded 2026-09-22 27f67a2f1e787c71 · report
fixture: signature hidden_states:Tensor/3/float, attention_mask:Tensor/4/float, head_mask:NoneType/0/? · returned Tensor · level recorded 2026-09-24 d30d6c3098df2c42 · report
fixture: signature layer:callable/0/?, index:Tensor/1/int, dim:int/0/int · returned Linear · level recorded 2026-09-22 9316b55d6dd78563 · report
c2f9c401f5379aac · report
fixture: signature n_nodes:int/0/int · returned list · level recorded 2026-09-24 c3c2cfe92ff4533d · report
fixture: signature model:callable/0/? · returned int · level recorded 2026-09-26 e8e6d419331bbeb9 · report
fixture: signature obj:list/1/int · returned bool · level recorded 2026-09-26 b2c96d966ff1fff8 · report
fixture: signature seqs:list/1/Tensor, length:int/0/int, padding_value:float/0/float · returned Tensor · level recorded 2026-09-26 0ae008bce547361e · report
fixture: signature task:str/0/str · returned str · level recorded 2026-09-26 92a75761ce94b769 · report
fixture: signature padded_sequences:Tensor/3/float, lengths:Tensor/1/int, batch_first:bool/0/bool · returned list · level recorded 2026-09-26 bc66f19be57720e7 · report
fixture: signature data:Tensor/2/float, segment_ids:Tensor/1/int, num_segments:int/0/int · returned Tensor · level recorded 2026-09-22 5fb62a78eb65d3d7 · report
fixture: signature data:Tensor/2/float, segment_ids:Tensor/1/int, num_segments:int/0/int · returned Tensor · level recorded 2026-09-22 c44e3a6568479588 · report
5b284cfc6cef732f · report
fixture: signature from_tensor:SymbolicTensor/3/float, to_mask:SymbolicTensor/2/int · returned SymbolicTensor · level recorded 2026-09-22 0d0b605c64dee09c · report
fixture: signature input_ids:SymbolicTensor/2/int, vocab_size:int/0/int, embedding_size:int/0/int, initializer_range:float/0/float, word_embedding_name:str/0/str, use_one_hot_embeddings:bool/0/bool · returned tuple · level recorded 2026-09-22 6588e020bee50b10 · report
fixture: signature input_tensor:SymbolicTensor/3/float, use_token_type:bool/0/bool, token_type_ids:SymbolicTensor/2/int, token_type_vocab_size:int/0/int, token_type_embedding_name:str/0/str, use_position_embeddings:bool/0/bool, position_embedding_name:str/0/str, initializer_range:float/0/float, max_position_embeddings:int/0/int, dropout_prob:float/0/float · returned SymbolicTensor · level recorded 2026-09-22 80bc5181b671b9a1 · report
fixture: signature input_tensor:SymbolicTensor/2/float, dropout_prob:float/0/float, name:str/0/str · returned EagerTensor · level recorded 2026-09-22 3f9027bb95cbe5b2 · report
fixture: returned AttentionLayer_sigmoid · level recorded 2026-09-22 9a71f87435326354 · report
3ade056bbe9a9e44 · report
ddb6510e4033acd8 · report
30699d853dda45e5 · report
fixture: signature filename:str/0/str · returned int · level recorded 2026-09-26 b4d10db840d16868 · report
fixture: signature text:str/0/str · returned str · level recorded 2026-09-26 b7ff454612b5dc62 · report
fixture: signature token:str/0/str · returned str · level recorded 2026-09-25 15ee33a6a02b924c · report
f3e68336634b8642 · report
fixture: signature preds:ndarray/2/float, labels:ndarray/1/int · returned float64 · level recorded 2026-09-22 eb140e13be89b1b9 · report
fixture: signature model_dir:str/0/str · returned RecursiveScriptModule · level recorded 2026-09-26 872b8d88173c74fb · report
fixture: signature input_data:tuple/1/Tensor, model:callable/0/? · returned Tensor · level recorded 2026-09-26 cfa5d6dc60bf1dba · report
fixture: signature input_ids:Tensor/2/int, attention_mask:Tensor/2/int, token_type_ids:Tensor/2/int, labels:Tensor/2/int, return_dict:bool/0/bool · returned MaskedLMOutput · level recorded 2026-09-24 cff5f4809af22623 · report
2fac2c94f3edf404 · report
b6d60d79c776054e · report
fixture: signature ustring:str/0/str · returned str · level recorded 2026-09-26 30636ab752ebf9b0 · report
fixture: signature filename:str/0/str · returned dict · level recorded 2026-09-26 1292768711b338b2 · report
056a394881f205d9 · report
546200b8426ef8b2 · report
286bc59709ec2901 · report
5e83fb6cbfb3f5a1 · report
d550d4124042659c · report
04868eaf79d84eb8 · report
96be08a7a7030f60 · report
fixture: returned BertConfig · level recorded 2026-09-22 c7123d4962da3767 · report
fixture: returned BertIntermediate · level recorded 2026-09-22 8f1a0b9437ccc562 · report
fixture: returned BertPooler · level recorded 2026-09-22 d7fe09a1ec2f4f0d · report
fixture: returned BertSelfAttention · level recorded 2026-09-22 7661139be003d514 · report
fixture: signature func:callable/0/? · returned function · level recorded 2026-09-22 5eff22fa0a651276 · report
fixture: signature url:str/0/str, etag:str/0/str · returned str · level recorded 2026-09-22 330e30e5ccfcc515 · report
77df05a2a5d00853 · report
0be65efc892d53b9 · report
89e0fd61eb3504eb · report
d94fb1043848be78 · report
aea48c66c585eea7 · report
fdd3d4990bea9d9c · report
5a3875e5bed5964b · report
ea4ad38c9db984c5 · report
317c17bb5ff9da3f · report
18f49ada16168f38 · report
51dd06ec77c8a8d1 · report
1079045e75efbf23 · report
d3852f416bfe86c3 · report
ac776e46fc1084e7 · report
fixture: signature ex_index:int/0/int, example:InputExample/0/?, label_list:list/1/str, max_seq_length:int/0/int, tokenizer:SimpleTokenizer/0/? · returned InputFeatures · level recorded 2026-09-26 54f786e4f28fa4a7 · report
79f120e0db5db99e · report
fixture: signature hidden_states:Tensor/3/float, attention_mask:Tensor/4/float, head_mask:NoneType/0/? · returned Tensor · level recorded 2026-09-24 b05a22e3a42e7e59 · report
b47ae2a32bd23a1c · report
3a44fb25423d4564 · report
a9444eeb146ebd10 · report
894b867bfd628865 · report
bd849e6c4737612e · report
855a80fcef9ad814 · report
351989ddc71c6405 · report
5de5474f1c41a96c · report
4b95ca6b1e45f55d · report
6ef8ca83e070ecc2 · report
18962b43885bc12f · report
fixture: signature task_names:str/0/str · returned list · level recorded 2026-09-22 f350435fecb66573 · report
fixture: returned BERTEmbedding · level recorded 2026-09-22 cba7955abe17fc7a · report
fixture: returned SegmentEmbedding · level recorded 2026-09-22 5f83a220fada640e · report
fixture: returned TokenEmbedding · level recorded 2026-09-22 81af9c02ca090c06 · report
e84e69f096395645 · report
fixture: signature input_tensor:Tensor/3/float, attention_mask:Tensor/4/float · returned Tensor · level recorded 2026-09-24 afc98bcdd9563e99 · report
fixture: returned BertConfig · level recorded 2026-09-22 0bc4f9d5bf271d61 · report
fixture: returned BertEmbeddings · level recorded 2026-09-22 b667cf8a44831efb · report
fixture: signature hidden_states:Tensor/3/float, attention_mask:Tensor/4/float · returned Tensor · level recorded 2026-09-24 822283b50e726811 · report
fixture: signature x:Tensor/3/float · returned Tensor · level recorded 2026-09-24 8a5a74db0d87b031 · report
fixture: returned BertOutput · level recorded 2026-09-22 e4d01ce175b1609c · report
fixture: signature hidden_states:Tensor/3/float, attention_mask:Tensor/4/float · returned Tensor · level recorded 2026-09-24 5d2d7e3a1b6801df · report
fixture: signature hidden_states:Tensor/3/float, input_tensor:Tensor/3/float · returned Tensor · level recorded 2026-09-24 4c39e580d926b422 · report
7014de3eb8095b4c · report
c56f29d49ac9ace5 · report
52ed11d585de58d4 · report
8165991d6f015e57 · report
024d457ec53d2bb4 · report
fixture: signature tag:str/0/str · returned str · level recorded 2026-09-26 780899d457cb7f07 · report
fixture: signature input_tensor:EagerTensor/2/float, dropout_prob:float/0/float · returned EagerTensor · level recorded 2026-09-22 558426bb4445df9f · report
0003cab2e9992161 · report
d3ccd60a5001eb36 · report
cf1f91679b130b04 · report
b9f693772b62b1de · report
36da368f07acddb7 · report
55ce9c59feb542e9 · report
8a8e46e7b74bcec6 · report
fixture: returned BertConfig · level recorded 2026-09-22 f27f0935fbe1b62b · report
fixture: returned BertIntermediate · level recorded 2026-09-22 1ffe5589b401ff00 · report
fixture: returned BertPooler · level recorded 2026-09-22 72415b9f7aa76ac9 · report
fixture: returned BertSelfAttention · level recorded 2026-09-22 5416853a8be3a2d7 · report
822402eb726689f9 · report
b824da45c7d85285 · report
39b12df168592d79 · report
57ddc6f7b4914314 · report
a0407d4bf4593206 · report
39f5d68d67913dc7 · report
178a7c8f563f0beb · report
af47ebae6c05725a · report
fixture: signature q:Tensor/3/float, k:Tensor/3/float, v:Tensor/3/float, mask:NoneType/0/? · returned Tensor · level recorded 2026-09-24 census: 5 implementations from 5 papers, 3 distinct outputs across 2 buckets, one shared input per bucket models.py ran Apache-2.0 (permissive) ·
2dcf1b4f0aa2fa9a · report
fixture: returned Block · level recorded 2026-09-22 b036f3e72b73df3d · report
fixture: returned Embeddings · level recorded 2026-09-22 census: 5 implementations from 5 papers, 5 distinct outputs across 3 buckets, one shared input per bucket models.py ran fingerprinted Apache-2.0 (permissive) ·
b0f94b02a9a6c057 · report
fixture: returned LayerNorm · level recorded 2026-09-22 05a7a0d5018b97f8 · report
fixture: signature x:Tensor/3/float, mask:Tensor/2/float · returned Tensor · level recorded 2026-09-24 a10a2edb3945c395 · report
fixture: returned PositionWiseFeedForward · level recorded 2026-09-22 4076b007bcd248ae · report
fixture: signature x:Tensor/2/int, seg:Tensor/2/int, mask:Tensor/2/float · returned Tensor · level recorded 2026-09-24 c76f46654250fbc5 · report
fixture: signature X:ndarray/2/float, Y:ndarray/1/int, key:str/0/str, results:dict/0/? · returned defaultdict · level recorded 2026-09-26 0087d8f08b1cc939 · report
census: 9 implementations from 7 papers, 9 distinct outputs across 3 buckets, one shared input per bucket model/bert.py ran no licence file found · pointer only ·
3c706b7d1522d9c1 · report
fixture: signature Q:EagerTensor/3/float, K:EagerTensor/3/float, V:EagerTensor/3/float, mask:NoneType/0/? · returned tuple · level recorded 2026-09-24 census: 43 implementations from 74 papers, 6 distinct outputs on one shared input model/bert.py ran · honoured contract fingerprinted no licence file found · pointer only ·
b7b8c4039090713d · report
fixture: signature x:EagerTensor/2/float · returned EagerTensor · level recorded 2026-09-22 2b635d82c194b84b · report
daa550ff0552c158 · report
e6c28dfaa7ebc812 · report
fixture: returned CollaborativeLayerAdapter · level recorded 2026-09-22 b2185f41548996b8 · report
fixture: signature model:callable/0/? · returned ModuleList · level recorded 2026-09-22 a7cc9ef1d10bc14b · report
census: 13 implementations from 12 papers, 10 distinct outputs across 4 buckets, one shared input per bucket transformer_bert_from_scratch_5.py ran · metamorphic tier: deterministic no licence file found · pointer only ·
fa24061b6aade569 · report
fixture: signature query:Tensor/3/float, key:Tensor/3/float, value:Tensor/3/float, mask:NoneType/0/?, dropout:NoneType/0/? · returned tuple · level recorded 2026-09-22 a42a5dbeebdf39e3 · report
fixture: returned BERTEmbedding · level recorded 2026-09-22 8708bfceac69760b · report
fixture: returned MultiHeadedAttention · level recorded 2026-09-22 census: 6 implementations from 6 papers, 4 distinct outputs across 3 buckets, one shared input per bucket transformer_bert_from_scratch_5.py ran · metamorphic tier: deterministic fingerprinted no licence file found · pointer only ·
d16f303823d8ee5a · report
fixture: returned PositionalEmbedding · level recorded 2026-09-22 708bd2d8037a185a · report
fixture: returned PositionwiseFeedForward · level recorded 2026-09-22 ec4cc2e0c00b6449 · report
fixture: returned SegmentEmbedding · level recorded 2026-09-22 740ab852bb4af958 · report
fixture: signature x:Tensor/2/float, sublayer:callable/0/? · returned Tensor · level recorded 2026-09-22 6ac09cf3d33d9991 · report
fixture: returned TokenEmbedding · level recorded 2026-09-22 7e19140b483ea0b1 · report
fixture: returned TransformerBlock · level recorded 2026-09-22 6674cc6102e96505 · report
f5690f33c176596b · report
82671c1f2dd13961 · report
fixture: signature s1:str/0/str, s2:str/0/str · returned int · level recorded 2026-09-26 58dd0d69e82ebdc9 · report
fixture: signature features:list/1/Feature, seq_length:int/0/int, is_training:bool/0/bool, drop_remainder:bool/0/bool · returned function · level recorded 2026-09-26 bc4091a4f3a214d8 · report
fixture: signature tokens_list:list/1/list, max_len:int/0/int · returned list · level recorded 2026-09-26 9b5d82a07fa47ec4 · report
fixture: signature vocab_filepath:str/0/str · returned dict · level recorded 2026-09-26 f3ed5b8073c1b457 · report
45edc5b78739e5e7 · report
47914b62d30c89d7 · report
fixture: signature hidden_states:Tensor/3/float, attention_mask:Tensor/4/float · returned tuple · level recorded 2026-09-24 236bedbe3bb10ca4 · report
e23a8af897f865c5 · report
3ab022fca9e1c155 · report
1cf3945c98c6c2f3 · report
6b54995ba252a2ac · report
432d01bfadb6127b · report
fixture: returned InputExample · level recorded 2026-09-22 deb446a77b1fa33a · report
fixture: returned InputFeatures · level recorded 2026-09-22 75c0c7f18ff966cd · report
fixture: signature example:InputExample/0/?, max_seq_length:int/0/int, tokenizer:MockTokenizer/0/? · returned InputFeatures · level recorded 2026-09-22 248a56618edd3caa · report
fixture: signature tokens:list/1/str, tokenizer:MockTokenizer/0/? · returned tuple · level recorded 2026-09-22 024276ac7a13ca21 · report
0e2c9d9757a88fbb · report
fixture: signature activation_string:str/0/str · returned function · level recorded 2026-09-22 880a4e01d58b0591 · report
fixture: signature x:Tensor/3/float, weights:Tensor/2/float · returned Tensor · level recorded 2026-09-25 9f1455d03e97305c · report
3625fdaae4382d86 · report
fae58f94f84bd6c2 · report
fixture: signature seq_q:Tensor/2/int, seq_k:Tensor/2/int · returned Tensor · level recorded 2026-09-22 census: 9 implementations from 7 papers, 9 distinct outputs across 3 buckets, one shared input per bucket 5-2.BERT/BERT.py unverified MIT (permissive) ·
aa4eb5c5bf00a8e5 · report
5f28d0d9dbdfbe97 · report
0953802ea4dc83a7 · report
fixture: signature text:str/0/str · returned str · level recorded 2026-09-26 cfdf5fac37771edf · report
3962b885663c0edd · report
60bfa1dabc7ab848 · report
21770a12e09aba7f · report
fixture: signature getter:callable/0/?, name:str/0/str, shape:tuple/1/int, dtype:DType/0/?, initializer:callable/0/?, regularizer:NoneType/0/?, trainable:bool/0/bool, args:tuple/1/empty, kwargs:dict/0/? · returned EagerTensor · level recorded 2026-09-22 census: 43 implementations from 74 papers, 6 distinct outputs on one shared input modeling.py ran · honoured contract fingerprinted Apache-2.0 (permissive) ·
a9f91ae77954f959 · report
fixture: signature x:EagerTensor/2/float · returned EagerTensor · level recorded 2026-09-22 fe35dab7a35b3957 · report
fixture: signature activation_string:str/0/str · returned function · level recorded 2026-09-22 d46b96cda962e830 · report
fixture: signature compute_type:DType/0/? · returned function · level recorded 2026-09-22 e2b4886c5ce3dcec · report
a9740dd2f1c01a4f · report
599deae552ebf869 · report
08131d4e8c12f7b0 · report
82dc008a899111c5 · report
f0fc6275fce8ef79 · report
ebe9bbd024b8363d · report
fixture: returned SymbolicTensor · level recorded 2026-09-22 6e650585e8d0a755 · report
135eb61e78abc50e · report
1c992b32418ba384 · report
0ecc5ad60cd279ca · report
e1076e465b586052 · report
7b6fa879bb8d0363 · report
ea7da1391dc2610d · report
e12264c69d5f6ed1 · report
a8dd78eaed472e6c · report
cd763e47e29c808f · report
fixture: signature x:EagerTensor/3/float · returned list · level recorded 2026-09-26 0899aefad9866244 · report
a1fd823bb2bb995b · report
b87767b29ecb8027 · report
46fcc6e1de355e47 · report
edc87736fbab8af0 · report
d6b3e8c4cfdf7880 · report
census: 8 implementations from 8 papers, 8 distinct outputs across 2 buckets, one shared input per bucket model/bert.py ran fingerprinted Apache-2.0 (permissive) ·
c777d006e1c7692c · report
fixture: returned Conv · level recorded 2026-09-22 4edee1c7737c7b5e · report
fixture: returned EncoderPrenet · level recorded 2026-09-22 eec394cb9b99cf20 · report
fixture: returned FFN · level recorded 2026-09-22 6f92bd1259c76a64 · report
fixture: returned Linear · level recorded 2026-09-22 0d4d097ae7a7f1de · report
fixture: signature key:Tensor/3/float, value:Tensor/3/float, query:Tensor/3/float, mask:NoneType/0/?, query_mask:NoneType/0/? · returned tuple · level recorded 2026-09-24 dcca3917b85d56dc · report
fixture: signature n_position:int/0/int, d_hid:int/0/int, padding_idx:NoneType/0/? · returned Tensor · level recorded 2026-09-22 census: 13 implementations from 12 papers, 10 distinct outputs across 4 buckets, one shared input per bucket model/bert.py unverified Apache-2.0 (permissive) ·
2f01baa6a2569f01 · report
873e08c3f15eb1e4 · report
fixture: signature input_tensor:EagerTensor/2/float, dropout_prob:float/0/float · returned EagerTensor · level recorded 2026-09-22 census: 36 implementations from 56 papers, 7 distinct outputs across 3 buckets, one shared input per bucket linalg.py ran fingerprinted Apache-2.0 (permissive) ·
5ee5f3de417ac23d · report
fixture: signature x:EagerTensor/2/float · returned EagerTensor · level recorded 2026-09-26 census: 6 implementations from 7 papers, 2 distinct outputs across 2 buckets, one shared input per bucket linalg.py ran fingerprinted Apache-2.0 (permissive) ·
00edc2dc619cd019 · report
fixture: signature x:EagerTensor/2/float · returned EagerTensor · level recorded 2026-09-26 47e15bf7d3423516 · report
d376d356370dc438 · report
bee3340c9aa9a937 · report
fixture: signature y_true:EagerTensor/2/float, y_pred:EagerTensor/2/float · returned EagerTensor · level recorded 2026-09-22 2e7b60e9f5611167 · report
4d9cbea89cdaecc9 · report
fixture: signature hidden_states:Tensor/3/float, context:Tensor/3/float, attention_mask:Tensor/4/float, policy:Tensor/2/int, current_index:int/0/int · returned tuple · level recorded 2026-09-24 f2559f88f4286ee8 · report
abcb694edfecc416 · report
2dc172f4dc0c745c · report
fixture: signature activation_string:str/0/str · returned function · level recorded 2026-09-22 74c0bfda0f255d96 · report
1e3dc39e015d88ab · report
80aef4984f2a61f8 · report
c7f933f28568cfaa · report
fixture: signature tokenizer:MockTokenizer/0/?, text:str/0/str · returned str · level recorded 2026-09-26 12be9ed008c3f47a · report
88d2575e81797042 · report
9a5abbce8429ae70 · report
601b94f2d092637c · report
d6be9b6981e1b7dd · report
fixture: returned BatchGeneratorForBERT · level recorded 2026-09-22 6bd23bdfeb17ff94 · report
fixture: signature ex_index:int/0/int, example:InputExample/0/?, label_list:list/1/str, max_seq_length:int/0/int, tokenizer:MinimalTokenizer/0/? · returned InputFeatures · level recorded 2026-09-26 11bbc9cf3f52d34b · report
78e003936d274d14 · report
fixture: signature data_dir:str/0/str, tags_file:str/0/str · returned set · level recorded 2026-09-26 151e18551b43baef · report
fixture: signature prev_tag:str/0/str, tag:str/0/str, prev_type:str/0/str, type_:str/0/str · returned bool · level recorded 2026-09-25 90ade26d2ce0e22f · report
fixture: signature seq:list/1/str, suffix:bool/0/bool · returned list · level recorded 2026-09-25 d8d0beca7d0f8ccb · report
fixture: signature checkpoint:str/0/str, model:callable/0/?, optimizer:SGD/0/? · returned dict · level recorded 2026-09-25 94f83a90c6177a65 · report
fixture: signature path_dataset:str/0/str · returned list · level recorded 2026-09-26 7373bfcd2aa77048 · report
fixture: signature prev_tag:str/0/str, tag:str/0/str, prev_type:str/0/str, type_:str/0/str · returned bool · level recorded 2026-09-25 876070eebb72f76a · report
fixture: returned BERTEmbedding · level recorded 2026-09-22 census: 13 implementations from 9 papers, 9 distinct outputs across 5 buckets, one shared input per bucket code/model/bert.py ran fingerprinted MIT (permissive) ·
8721b3fce91b7165 · report
fixture: returned PositionalEncoding · level recorded 2026-09-22 a56b4078536a7e01 · report
bb6ffa608bbf657a · report
9b28507fe7a827ac · report
cf9ffa02a42184af · report
fixture: signature text:str/0/str · returned list · level recorded, date not recorded census: 43 implementations from 74 papers, 6 distinct outputs on one shared input this sample: bucket 1 of 1, arg 1: rank 2, kind float, dtype float32 pybert/model/albert/modeling_bert.py ran · honoured contract fingerprinted MIT (permissive) here; the stored copy is pointer only ·
211753ba29188d4e · report
fixture: signature x:Tensor/2/float · returned Tensor · level recorded 2026-09-22 census: 3 implementations from 7 papers, 1 distinct output on one shared input this sample: bucket 1 of 1, arg 1: rank 2, kind float, dtype float32 pybert/model/albert/modeling_bert.py ran · honoured contract fingerprinted MIT (permissive) here; the stored copy is pointer only ·
77601724cad03f95 · report
fixture: signature x:Tensor/2/float · returned Tensor · level recorded 2026-09-22 0c145728a35789fa · report
fixture: signature model:callable/0/?, config:Config/0/?, tf_checkpoint_path:str/0/str · returned BertModel · level recorded 2026-09-22 659f3761c1dc81fa · report
fixture: signature vocab_file:str/0/str · returned OrderedDict · level recorded 2026-09-24 4c8dd71a74ae58f4 · report
fixture: returned BertConfig · level recorded 2026-09-22 9597f5146c4fa55c · report
fixture: returned BertIntermediate · level recorded 2026-09-22 534dfe582037c26b · report
fixture: signature url_or_filename:str/0/str, cache_dir:str/0/str · returned str · level recorded 2026-09-22 d03f582131d8575c · report
fixture: signature func:callable/0/? · returned function · level recorded 2026-09-22 1f8e0d57a93f2b98 · report
fixture: signature url:str/0/str · returned tuple · level recorded 2026-09-22 af64ec220e8bcdbc · report
fixture: signature url:str/0/str, etag:str/0/str · returned str · level recorded 2026-09-22 978bca45efc60c53 · report
c265396993793fbf · report
064f9026080680e2 · report
4ea9890699c11b28 · report
0a619d4800774912 · report
fb6862928ef36d03 · report
35ea09ed4f1542c2 · report
e25398920d88eec3 · report
20bb0eaadd1d38ce · report
43b164ab6ace951e · report
d3da3cf9bfe8b9a5 · report
3cbc191d5ba7a810 · report
fixture: signature y_true:ndarray/1/int, y_pred:ndarray/1/int · returned tuple · level recorded 2026-09-26 19a646c088e51dd7 · report
fixture: signature local_path:str/0/str, server_path:str/0/str · returned str · level recorded 2026-09-26 0e1d7c4bb776fe62 · report
fixture: signature seq_q:Tensor/2/int, seq_k:Tensor/2/int · returned Tensor · level recorded 2026-09-26 149f493786f28d23 · report
fixture: signature input_tensor:Tensor/3/float, attention_mask:Tensor/4/float · returned Tensor · level recorded 2026-09-24 95de1baf9219476c · report
fixture: signature input_ids:Tensor/2/int, token_type_ids:Tensor/2/int · returned Tensor · level recorded 2026-09-22 db45f6229b637fb4 · report
fixture: signature x:Tensor/3/float · returned Tensor · level recorded 2026-09-22 85b548d92c70c22b · report
fixture: signature hidden_states:Tensor/3/float, input_tensor:Tensor/3/float · returned Tensor · level recorded 2026-09-22 5c90e4d2568bfcd1 · report
fixture: signature hidden_states:Tensor/3/float, input_tensor:Tensor/3/float · returned Tensor · level recorded 2026-09-22 6b926a4dea58d814 · report
fixture: signature url_or_filename:str/0/str, cache_dir:str/0/str · returned str · level recorded 2026-09-22 740f60e01d11ace6 · report
7e1548e1a31a85bc · report
6f23494271c18741 · report
4f399deeb0300ce5 · report
5819c9932ff45111 · report
f2aa87ff483796f8 · report
6725fc5eaa566426 · report
e2bfbb357751d986 · report
fixture: signature text:str/0/str · returned str · level recorded 2026-09-26 242ba183419ac2b3 · report
71806f38591c80b6 · report
1d2a6caabd9dc5f0 · report
fixture: signature s:str/0/str, debug:bool/0/bool · returned str · level recorded 2026-09-24 4b450fe6cbd79881 · report
fixture: signature actual:list/1/str, predicted:list/1/str · returned float · level recorded 2026-09-26 b5f23937875fe0ba · report
fixture: signature gold_labels:list/1/str, test_labels:list/1/str · returned tuple · level recorded 2026-09-26 c070006ff55cd83a · report
1afbd244a1386ac2 · report
aac15b5f40a6b617 · report
fixture: returned BertConfig · level recorded 2026-09-22 f302dc3e27e4899c · report
fixture: returned BertMultiHeadSelfAttention · level recorded 2026-09-22 b8840d088409a430 · report
fixture: signature checkpoint_file:str/0/str · returned function · level recorded 2026-09-22 29b9ba476de00900 · report
fixture: signature input_ids:EagerTensor/2/int · returned EagerTensor · level recorded 2026-09-22 4ad0a0a5c8931d4f · report
e34f104652a8da5a · report
1e2cc37deb600404 · report
22f2bcc8465b2203 · report
fixture: signature example:InputExample/0/?, max_seq_length:int/0/int, tokenizer:SimpleTokenizer/0/? · returned InputFeatures · level recorded 2026-09-24 a72f84dbce6c5d65 · report
fixture: signature tokens:list/1/str, tokenizer:SimpleTokenizer/0/? · returned tuple · level recorded 2026-09-24 3fb8e7a9fb8c481b · report
996de2f5520cce23 · report
d9e00c99bc3b43d2 · report
fixture: signature start_time:float/0/float · returned timedelta · level recorded 2026-09-22 1d395be1e3a96352 · report
d395611f9cd6a0d3 · report
fixture: signature text:str/0/str · returned tuple · level recorded 2026-09-26 d2b920290dd11a30 · report
fixture: signature c:str/0/str · returned bool · level recorded 2026-09-24 49b90dc3f10fce0a · report
f2fb2830bbc816a7 · report
9e9a027310f7dd84 · report
d38eef6a039776c4 · report
2a545c0405dc1c93 · report
fixture: signature question:str/0/str, context:str/0/str · returned str · level recorded 2026-09-24 135b3dc835ffe6ad · report
2d8aa8d9d0c2d5e5 · report
fixture: signature tensor:EagerTensor/2/float, expected_rank:int/0/int, name:str/0/str · returned list · level recorded 2026-09-22 e118b009c023bf15 · report
fixture: returned SymbolicTensor · level recorded 2026-09-22 c18bd0ef8d750675 · report
f4788df953d5dec3 · report
ddcb3c30efc18240 · report
1d6176191bd79227 · report
05cc60302ae6f12e · report
census: 6 implementations from 6 papers, 4 distinct outputs across 3 buckets, one shared input per bucket torchtext/models/roberta/model.py ran · metamorphic tier: deterministic fingerprinted BSD-3-Clause (permissive) ·
4631d4896f7b464d · report
fixture: returned PositionalEmbedding · level recorded 2026-09-22 3fa8b8c8ef28e810 · report
fixture: returned TransformerEncoder · level recorded 2026-09-22 46de24beef44cf28 · report
9be5a608b03add6a · report
fixture: signature hidden_states:Tensor/3/float · returned Tensor · level recorded 2026-09-24 census: 43 implementations from 74 papers, 6 distinct outputs on one shared input this sample: bucket 1 of 1, arg 1: rank 2, kind float, dtype float32 chinese_gpt/gpt_modeling.py ran · honoured contract fingerprinted MIT (permissive) ·
409ea40d28f93c7e · report
fixture: signature x:Tensor/2/float · returned Tensor · level recorded 2026-09-22 207b46bd316070c6 · report
07f05b67a5afe0dd · report
946cd24442973489 · report
03a3d15424bea269 · report
68634f7940230fc2 · report
515b61ea2a383523 · report
33a8a91417a6d8be · report
fixture: returned Encoder · level recorded 2026-09-22 3696bbf61fdf1966 · report
fixture: returned EncoderLayer · level recorded 2026-09-22 census: 9 implementations from 7 papers, 9 distinct outputs across 3 buckets, one shared input per bucket utils.py ran no licence file found · pointer only ·
d0f7a90c6c7d9e89 · report
fixture: returned MultiHeadAttention · level recorded 2026-09-22 census: 13 implementations from 9 papers, 9 distinct outputs across 5 buckets, one shared input per bucket utils.py ran no licence file found · pointer only ·
02b4f900d43f5cdf · report
fixture: signature inputs:EagerTensor/3/float · returned EagerTensor · level recorded 2026-09-24 aa2d3d2c35ae9b63 · report
fixture: signature queries:EagerTensor/3/float, keys:EagerTensor/3/float, values:EagerTensor/3/float, mask:NoneType/0/? · returned SymbolicTensor · level recorded 2026-09-22 003d124d2d8b1d66 · report
fixture: signature inputs:EagerTensor/2/int · returned EagerTensor · level recorded 2026-09-24 dfc55eabce3cbf08 · report
fixture: signature inputs:EagerTensor/2/int · returned list · level recorded 2026-09-24 census: 43 implementations from 74 papers, 6 distinct outputs on one shared input keras_bert/bert.py ran · honoured contract fingerprinted MIT (permissive) ·
ac6081d51f65bb8c · report
fixture: signature x:EagerTensor/2/float · returned EagerTensor · level recorded 2026-09-22 370681b0385cf8f7 · report
fixture: signature input_ids:SymbolicTensor/2/int, vocab_size:int/0/int, embedding_size:int/0/int, initializer_range:float/0/float, word_embedding_name:str/0/str, use_one_hot_embeddings:bool/0/bool · returned tuple · level recorded 2026-09-22 80cc7be4b4ecc856 · report
24b1b48f866e424b · report
69ead5ac4ce92603 · report
census: 14 implementations from 37 papers, 2 distinct outputs on one shared input this sample: bucket 1 of 1, arg 1: rank 2, kind float, dtype float32 mockingjay/model.py identical code Syntology harvested from this repository for another paper; this paper's link records no repository, path or licence of its own ran · our draft was wrong fingerprinted licence of this copy not recorded ·
0f786c407fb1ee4c · report
fixture: signature x:Tensor/2/float · returned Tensor · level recorded, date not recorded census: 43 implementations from 74 papers, 6 distinct outputs on one shared input this sample: bucket 1 of 1, arg 1: rank 2, kind float, dtype float32 mockingjay/model.py identical code Syntology harvested from this repository for another paper; this paper's link records no repository, path or licence of its own ran · honoured contract fingerprinted licence of this copy not recorded ·
fdc64f4c72036ae4 · report
fixture: signature x:Tensor/2/float · returned Tensor · level recorded 2026-09-22 8157123cc1775d1e · report
fixture: signature dl:MockDataLoader/0/?, labels:list/1/list, fn:callable/0/? · returned tuple · level recorded 2026-09-26 8fe6f64121265de8 · report
fixture: signature current_token:str/0/str, previous_token:str/0/str, tag:str/0/str · returned tuple · level recorded 2026-09-26 035ea178c05466c1 · report
fixture: signature tok_map:list/1/int, labels:list/1/str · returned list · level recorded 2026-09-26 66fa78e9ac27aa7d · report
fixture: signature history:list/1/str, metric_:str/0/str, sup_labels:set/0/? · returned defaultdict · level recorded 2026-09-26 2c175ed3d644a05b · report
fixture: signature history:list/1/str, metric_:str/0/str, sup_labels:set/0/?, return_idx:bool/0/bool · returned list · level recorded 2026-09-26 a8131461fa7068c6 · report
fixture: signature text_res:str/0/str, sup_labels:set/0/? · returned dict · level recorded 2026-09-26 85582e663abb69b2 · report
fixture: signature origin:str/0/str, other:str/0/str · returned str · level recorded 2026-09-26 census: 10 implementations from 12 papers, 5 distinct outputs across 3 buckets, one shared input per bucket modules/layers/ncrf.py ran · our draft was wrong fingerprinted MIT (permissive) ·
8e960fbb64668568 · report
fixture: signature vec:Tensor/3/float, m_size:int/0/int · returned Tensor · level recorded 2026-09-22 4c742d96ba772447 · report
fixture: signature y_true:list/1/list, y_pred:list/1/list, print_results:bool/0/bool, short_report:bool/0/bool, entity_of_interest:NoneType/0/? · returned OrderedDict · level recorded 2026-09-26 b0e7a08c13d6535c · report
fixture: signature config:str/0/str · returned dict · level recorded 2026-09-26 census: 12 implementations from 15 papers, 5 distinct outputs across 2 buckets, one shared input per bucket modules/layers/crf.py ran MIT (permissive) ·
fbfd610e4235afd9 · report
fixture: signature lens:Tensor/1/int, max_len:NoneType/0/? · returned Tensor · level recorded 2026-09-26 12b283b1c138a097 · report
fixture: signature tok_map:list/1/int, labels:list/1/str · returned list · level recorded 2026-09-26 census: 10 implementations from 12 papers, 5 distinct outputs across 3 buckets, one shared input per bucket modules/layers/crf.py unverified MIT (permissive) ·
913ba2502c2a2780 · report
5e8114b1fe8c40c2 · report
fixture: signature parser:SimpleParser/0/? · returned Args · level recorded 2026-09-26 e5e4ad8ef8a96e8d · report
9b35e4cf0e15ffdd · report
fixture: returned Embedding · level recorded 2026-09-22 ce2916d914cf9fba · report
fixture: returned FeedForward · level recorded 2026-09-22 94f00401c270fbfb · report
fixture: returned MultiHeadAttn · level recorded 2026-09-22 3ee5d7228f9f7413 · report
241a2b5370690f9c · report
6df6bb15564e69a3 · report
5eb87d3a8fc7de9a · report
5922b08ec3b74b7c · report
1705400ad5892c18 · report
b197bed5dd8fcba3 · report
11125cd0d694ad61 · report
a181d94c3334306d · report
0ccbf8e553bab00d · report
e9ff615e1693ffe4 · report
4dc95113de962a34 · report
fixture: signature labels:list/1/int, num_labels:int/0/int · returned list · level recorded 2026-09-26 683a4be67f944ea1 · report
fixture: signature input_ids:Tensor/2/int, attention_mask:Tensor/2/float, token_type_ids:Tensor/2/int, raw_score:Tensor/1/float · returned tuple · level recorded 2026-09-24 b40fc12ef51e9ccc · report
fixture: signature tokens:list/1/str, masked_lm_prob:float/0/float, max_predictions_per_seq:int/0/int, vocab_words:list/1/str, rng:SimpleRNG/0/? · returned tuple · level recorded 2026-09-22 595d45bc07678f87 · report
fixture: signature text:str/0/str · returned str · level recorded 2026-09-26 1b8d053b2662bc2d · report
fixture: signature text:str/0/str · returned str · level recorded 2026-09-26 b67ad78f40e86899 · report
9f3b950a4be83ebe · report
fixture: signature seq:Tensor/2/int, seg:Tensor/2/int · returned Tensor · level recorded 2026-09-24 ec36188bdac79842 · report
fixture: signature seq:Tensor/2/int, seg:Tensor/2/int · returned Tensor · level recorded 2026-09-22 34c1f2337ffb814d · report
79608bac19b3ff5c · report
census: 9 implementations from 7 papers, 9 distinct outputs across 3 buckets, one shared input per bucket transformer/Transformer.py ran MIT (permissive) ·
f96d7fde8876634b · report
fixture: signature q:Tensor/3/float, k:Tensor/3/float, v:Tensor/3/float, mask:Tensor/3/bool · returned tuple · level recorded 2026-09-24 c47eb374e0a8f194 · report
fixture: returned PositionwiseFeedForward · level recorded 2026-09-22 1bfb42c8f8e10514 · report
fixture: returned ScaledDotProductAttention · level recorded 2026-09-22 42ed669c77870eb8 · report
c6995481c008210c · report
2f1e6f999036c38d · report
fixture: returned BertConfig · level recorded 2026-09-22 348c6586dd6fcb82 · report
85b6ae362d64e02e · report
7fcd355aa43ef519 · report
8d35a5c30d46d2df · report
ff96aaf623cca5f3 · report
4b258860805ea4d3 · report
594c968dcdc272f1 · report
fixture: signature cmd:str/0/str, s:str/0/str · returned str · level recorded 2026-09-26 0a8d963b1703c1e8 · report
fixture: signature cmd:str/0/str, key:str/0/str, value:str/0/str · returned str · level recorded 2026-09-26 f54c096131164be1 · report
fixture: signature assessment_method:str/0/str, callback:AccuracyCallback/0/? · returned float · level recorded 2026-09-26 e512be7d0748330e · report
fixture: signature assessment_method:str/0/str, callback:AccuracyCallback/0/? · returned float · level recorded 2026-09-26 95e64675393bf4aa · report
fixture: signature cmd:str/0/str, logic_id:int/0/int, rank_id:int/0/int · returned str · level recorded 2026-09-26 4073de88226e1038 · report
fixture: returned BertIntermediate · level recorded 2026-09-22 cc2f2a6451c34620 · report
fixture: returned BertPooler · level recorded 2026-09-22 deecd100e8c17400 · report
fixture: returned BertSelfAttention · level recorded 2026-09-22 69b2af37fc2ae145 · report
fixture: returned LinearActivation · level recorded 2026-09-22 de5ea2929d4e4106 · report
fixture: returned Tensor · level recorded 2026-09-22 99b92d0744d0386d · report
fixture: returned Tensor · level recorded 2026-09-22 51bd5bf32f9bb46c · report
fixture: returned Tensor · level recorded 2026-09-22 census: 43 implementations from 74 papers, 6 distinct outputs on one shared input this sample: bucket 1 of 1, arg 1: rank 2, kind float, dtype float32 hetseq/bert_modeling.py ran; the contract check could not run (RAISES) MIT (permissive) ·
1ada98e81f3ec64a · report
fixture: returned Tensor · level recorded 2026-09-22 0cb54ae12a698d67 · report
87487781c4dcd1a1 · report
bae337e27b7faff5 · report
59bcd923687ae5b0 · report
d3b9deead826313f · report
3b6fe2941d20238a · report
fixture: signature sentence:list/1/str, tokenizer:StandInTokenizer/0/? · returned list · level recorded 2026-09-26 74d797f5a80810b0 · report
9da7a2d2772fa7d0 · report
2a296bcff09a0034 · report
95cf64fa85a7e558 · report
8afaa985063f723e · report
fixture: signature module_or_pth_file:callable/0/?, model:str/0/str · returned dict · level recorded 2026-09-24 e8ae42ea576c0232 · report
fixture: signature attention_mask:Tensor/2/int · returned Tensor · level recorded 2026-09-24 census: 9 implementations from 11 papers, 3 distinct outputs on one shared input cybertron/models/bart.py unverified Apache-2.0 (permissive) ·
8f0494a0f9a303b8 · report
eae4db3e250e2cba · report
4 samples are identical to code Syntology harvested from another paper's repository; this paper's own copy was not located, so no repository is named and no licence is recorded.
census: 43 implementations from 74 papers, 6 distinct outputs on one shared input this sample: bucket 1 of 1, arg 1: rank 2, kind float, dtype float32 repository not located ran · honoured contract fingerprinted licence of this copy not recorded ·
62e7409a816626ac · report
fixture: signature x:Tensor/2/float · returned Tensor · level recorded 2026-09-22 census: 43 implementations from 74 papers, 6 distinct outputs on one shared input this sample: bucket 1 of 1, arg 1: rank 2, kind float, dtype float32 repository not located ran · honoured contract fingerprinted licence of this copy not recorded ·
40e9fee2e0b7e278 · report
fixture: signature x:Tensor/2/float · returned Tensor · level recorded 2026-09-22 b1a7180868dd8d6a · report
0453ed29d1aecc4c · report
Method as code Syntology
What Syntology's graph records as this paper's claimed method, lifted into code: each assembly names its bricks (functions and classes), each with its own role and its own verification level. An assembly is not a check that the code implements the method correctly or reproduces the paper's results. Levels are each brick's own verification level in Syntology's graph (level 0: no recorded run), listed brick by brick and never combined into one level; “ran” means the brick executed on a synthesized input, not that its output is correct, and the instrument figure counts failures of Syntology's instrument, not of the code. Where a model read the code against the paper's claim, each assembly's label verdict is one model's judgement, kept in this page's JSON twin; it is not calibrated, so no card prints it. Siblings are assemblies lifted from this paper in the same batch for the same method: alternative readings kept side by side; none replaces or supersedes another.
115 assemblies on this paper: 115 harvested, 0 generated, listed in 1 groups (siblings lifted in one batch form one group).
115 sibling assemblies for BERT (harvested), lifted in the same batch on 2026-09-09: alternative readings kept side by side; none replaces or supersedes another. Bricks printed for 12 of 115 sibling assemblies; the other 103 are listed with their counts; every brick is in this page's JSON twin.
harvested Assembly for BERT (graph method: BERT). 23 bricks; individually on a fixture: 8 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 15 unverified. The assembly has not been run end-to-end.
one of 115 siblings
- BertModel entry · level 0 · unverified ·
d94fb1043848be78 - BertEmbeddings model · level 0 · unverified ·
77df05a2a5d00853 - BertEncoder model · level 0 · unverified ·
0be65efc892d53b9 - BertPooler model · level 1 · ran ·
8f1a0b9437ccc562 - BertPreTrainedModel helper · level 0 · unverified ·
fdd3d4990bea9d9c - BertLayer helper · level 0 · unverified ·
89e0fd61eb3504eb - BertConfig helper · level 1 · ran ·
96be08a7a7030f60 - cached_path helper · level 0 · unverified ·
ea4ad38c9db984c5 - load_tf_weights_in_bert helper · level 0 · unverified ·
b1a7180868dd8d6a - BertAttention helper · level 0 · unverified ·
330e30e5ccfcc515 - BertIntermediate helper · level 1 · ran ·
c7123d4962da3767 - BertOutput helper · level 0 · unverified ·
aea48c66c585eea7 - get_from_cache helper · level 0 · unverified ·
317c17bb5ff9da3f - BertSelfAttention helper · level 1 · ran ·
d7fe09a1ec2f4f0d - BertSelfOutput helper · level 0 · unverified ·
5a3875e5bed5964b - http_get helper · level 0 · unverified ·
18f49ada16168f38 - s3_etag helper · level 0 · unverified ·
51dd06ec77c8a8d1 - s3_get helper · level 0 · unverified ·
1079045e75efbf23 - url_to_filename helper · level 1 · ran · our draft was wrong ·
5eff22fa0a651276 - s3_request helper · level 1 · ran · our draft was wrong ·
7661139be003d514 - split_s3_path helper · level 0 · unverified ·
d3852f416bfe86c3 - gelu helper · level 1 · ran · honoured contract ·
fdc64f4c72036ae4 - swish helper · level 2 · ran · our draft was wrong ·
0f786c407fb1ee4c
harvested Assembly for BERT (graph method: BERT). 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified. The assembly has not been run end-to-end.
one of 115 siblings
- BertModel entry · level 0 · unverified ·
c1c5de65dfedcf88 - create_attention_mask_from_input_mask model · level 0 · unverified ·
a019ca35d0434118 - create_initializer helper · level 0 · unverified ·
e3981aa2fadfb2eb - embedding_lookup model · level 0 · unverified ·
194a6562b994a2e1 - embedding_postprocessor model · level 0 · unverified ·
277b18bc7acee12c - get_activation helper · level 1 · ran · our draft was wrong ·
61de2f8dfc7d014a - get_shape_list helper · level 1 · ran · our draft was wrong ·
4c33136de32333c9 - transformer_model model · level 0 · unverified ·
dbc9628a5ca3b1f5 - layer_norm_and_dropout helper · level 0 · unverified ·
61cb05022cc82f2b - gelu helper · level 0 · unverified ·
71e7e82f26b8d902 - assert_rank helper · level 0 · unverified ·
01e4a365b28cda00 - attention_layer model · level 0 · unverified ·
62ba879682ced155 - dropout helper · level 1 · ran; the contract check could not run (RAISES) ·
fb518a8fa5849d2f - layer_norm helper · level 0 · unverified ·
fedeb6766bad1fad - reshape_from_matrix helper · level 0 · unverified ·
3cfa2e7b4d67e9ee - reshape_to_matrix helper · level 1 · ran · our draft was wrong ·
7b84f3e6a96584b4
harvested Assembly for BERT (graph method: BERT). 16 bricks; individually on a fixture: 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 11 unverified. The assembly has not been run end-to-end.
one of 115 siblings
- BertModel entry · level 0 · unverified ·
b84a7e54141c42d4 - create_attention_mask_from_input_mask model · level 0 · unverified ·
ecf19688a7eb0d04 - create_initializer helper · level 0 · unverified ·
e3981aa2fadfb2eb - embedding_lookup model · level 0 · unverified ·
fe0428bc0b127744 - embedding_postprocessor model · level 0 · unverified ·
9c69503daf39b4c9 - get_activation helper · level 1 · ran · our draft was wrong ·
5842ee67106321d6 - get_shape_list helper · level 1 · ran · our draft was wrong ·
5a657fd9d0832b35 - transformer_model model · level 0 · unverified ·
e353d671edbdf34f - layer_norm_and_dropout helper · level 0 · unverified ·
15f847b95346c6d2 - gelu helper · level 1 · ran · honoured contract ·
d08f324f950148de - assert_rank helper · level 0 · unverified ·
3626c55dff7dd429 - attention_layer model · level 0 · unverified ·
d16dcfaecf4647ad - dropout helper · level 1 · ran; the contract check could not run (RAISES) ·
873e08c3f15eb1e4 - layer_norm helper · level 0 · unverified ·
fedeb6766bad1fad - reshape_from_matrix helper · level 0 · unverified ·
b1f366f8472004a2 - reshape_to_matrix helper · level 1 · ran · our draft was wrong ·
7b84f3e6a96584b4
harvested Assembly for BERT (graph method: BERT). 16 bricks; individually on a fixture: 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 11 unverified. The assembly has not been run end-to-end.
one of 115 siblings
- BertModel entry · level 0 · unverified ·
f298a22a9d079be3 - create_attention_mask_from_input_mask helper · level 0 · unverified ·
ecf19688a7eb0d04 - create_initializer helper · level 0 · unverified ·
e3981aa2fadfb2eb - embedding_lookup model · level 0 · unverified ·
fe0428bc0b127744 - embedding_postprocessor model · level 0 · unverified ·
34c1f2337ffb814d - get_activation helper · level 1 · ran · our draft was wrong ·
5842ee67106321d6 - get_shape_list helper · level 1 · ran · our draft was wrong ·
5a657fd9d0832b35 - transformer_model model · level 0 · unverified ·
79608bac19b3ff5c - layer_norm_and_dropout helper · level 0 · unverified ·
15f847b95346c6d2 - gelu helper · level 1 · ran · honoured contract ·
d08f324f950148de - assert_rank helper · level 0 · unverified ·
3626c55dff7dd429 - attention_layer model · level 0 · unverified ·
d16dcfaecf4647ad - dropout helper · level 1 · ran; the contract check could not run (RAISES) ·
873e08c3f15eb1e4 - layer_norm helper · level 0 · unverified ·
fedeb6766bad1fad - reshape_from_matrix helper · level 0 · unverified ·
b1f366f8472004a2 - reshape_to_matrix helper · level 1 · ran · our draft was wrong ·
7b84f3e6a96584b4
harvested Assembly for BERT (graph method: BERT). 14 bricks; individually on a fixture: 5 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 9 unverified. The assembly has not been run end-to-end.
one of 115 siblings
- BertModel entry · level 0 · unverified ·
57ddc6f7b4914314 - BertEmbeddings model · level 0 · unverified ·
822402eb726689f9 - BertEncoder model · level 0 · unverified ·
b824da45c7d85285 - BertPooler model · level 1 · ran ·
1ffe5589b401ff00 - BertPreTrainedModel helper · level 0 · unverified ·
39f5d68d67913dc7 - BertLayer model · level 0 · unverified ·
39b12df168592d79 - BertConfig helper · level 1 · ran ·
8a8e46e7b74bcec6 - load_tf_weights_in_bert helper · level 0 · unverified ·
0453ed29d1aecc4c - BertAttention model · level 0 · unverified ·
5416853a8be3a2d7 - BertIntermediate model · level 1 · ran ·
f27f0935fbe1b62b - BertOutput model · level 0 · unverified ·
a0407d4bf4593206 - BertSelfAttention model · level 1 · ran ·
72415b9f7aa76ac9 - BertSelfOutput helper · level 0 · unverified ·
178a7c8f563f0beb - gelu helper · level 1 · ran · honoured contract ·
fdc64f4c72036ae4
harvested Assembly for BERT (graph method: BERT). 22 bricks; individually on a fixture: 10 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 5 where Syntology's instrument failed) · 12 unverified. The assembly has not been run end-to-end.
one of 115 siblings
- BertModel entry · level 0 · unverified ·
0a619d4800774912 - BertEmbeddings model · level 0 · unverified ·
c265396993793fbf - BertEncoder model · level 0 · unverified ·
064f9026080680e2 - BertPooler model · level 1 · ran ·
8f1a0b9437ccc562 - PreTrainedBertModel helper · level 0 · unverified ·
35ea09ed4f1542c2 - BertLayer model · level 0 · unverified ·
4ea9890699c11b28 - BertConfig helper · level 1 · ran ·
4c8dd71a74ae58f4 - cached_path helper · level 1 · ran · our draft was wrong ·
534dfe582037c26b - BertAttention model · level 0 · unverified ·
978bca45efc60c53 - BertIntermediate model · level 1 · ran ·
9597f5146c4fa55c - BertOutput model · level 0 · unverified ·
fb6862928ef36d03 - get_from_cache helper · level 0 · unverified ·
e25398920d88eec3 - BertSelfAttention model · level 1 · ran ·
d7fe09a1ec2f4f0d - BertSelfOutput helper · level 0 · unverified ·
178a7c8f563f0beb - http_get helper · level 0 · unverified ·
20bb0eaadd1d38ce - s3_etag helper · level 0 · unverified ·
43b164ab6ace951e - s3_get helper · level 0 · unverified ·
d3da3cf9bfe8b9a5 - url_to_filename helper · level 1 · ran · our draft was wrong ·
af64ec220e8bcdbc - s3_request helper · level 1 · ran · our draft was wrong ·
d03f582131d8575c - split_s3_path helper · level 1 · ran · our draft was wrong ·
1f8e0d57a93f2b98 - gelu helper · level 1 · ran · honoured contract ·
40e9fee2e0b7e278 - swish helper · level 2 · ran · our draft was wrong ·
0f786c407fb1ee4c
harvested Assembly for BERT (graph method: BERT). 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified. The assembly has not been run end-to-end.
one of 115 siblings
- BertModel entry · level 0 · unverified ·
1c8f5d63388f5841 - create_attention_mask_from_input_mask model · level 0 · unverified ·
ecf19688a7eb0d04 - create_initializer helper · level 0 · unverified ·
e3981aa2fadfb2eb - embedding_lookup model · level 0 · unverified ·
a8b0e78302dc02d4 - embedding_postprocessor model · level 0 · unverified ·
9c69503daf39b4c9 - get_activation helper · level 1 · ran · our draft was wrong ·
5681f7dd9b6e3679 - get_shape_list helper · level 1 · ran · our draft was wrong ·
5a657fd9d0832b35 - transformer_model model · level 0 · unverified ·
4f87a173bcbfc6e5 - layer_norm_and_dropout helper · level 0 · unverified ·
15f847b95346c6d2 - gelu helper · level 0 · unverified ·
ecab128238ebf253 - assert_rank helper · level 0 · unverified ·
3626c55dff7dd429 - attention_layer model · level 0 · unverified ·
f648a4567745fd52 - dropout helper · level 1 · ran; the contract check could not run (RAISES) ·
873e08c3f15eb1e4 - layer_norm helper · level 0 · unverified ·
fedeb6766bad1fad - reshape_from_matrix helper · level 0 · unverified ·
b1f366f8472004a2 - reshape_to_matrix helper · level 1 · ran · our draft was wrong ·
7b84f3e6a96584b4
harvested Assembly for BERT (graph method: BERT). 3 bricks; individually on a fixture: 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 2 samples that ran constructed an object rather than computing a result. The assembly has not been run end-to-end.
one of 115 siblings
- RobertaEncoder entry · level 0 · unverified ·
46de24beef44cf28 - TransformerEncoder model · level 1 · ran ·
3fa8b8c8ef28e810 - PositionalEmbedding model · level 1 · ran ·
4631d4896f7b464d
harvested Assembly for BERT (graph method: BERT). 18 bricks; individually on a fixture: 7 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 6 where Syntology's instrument failed) · 11 unverified. The assembly has not been run end-to-end.
one of 115 siblings
- BertModel entry · level 0 · unverified ·
4d900dd3364ebe60 - create_attention_mask_from_input_mask model · level 0 · unverified ·
a9740dd2f1c01a4f - create_initializer helper · level 0 · unverified ·
e3981aa2fadfb2eb - embedding_lookup model · level 0 · unverified ·
599deae552ebf869 - embedding_postprocessor model · level 0 · unverified ·
08131d4e8c12f7b0 - get_activation helper · level 1 · ran · our draft was wrong ·
fe35dab7a35b3957 - get_custom_getter helper · level 1 · ran · our draft was wrong ·
d46b96cda962e830 - get_shape_list helper · level 1 · ran · our draft was wrong ·
35fdcad846dde14a - transformer_model model · level 0 · unverified ·
f0fc6275fce8ef79 - layer_norm_and_dropout helper · level 0 · unverified ·
82dc008a899111c5 - gelu helper · level 1 · ran · honoured contract ·
a9f91ae77954f959 - float32_variable_storage_getter helper · level 1 · ran; the contract check could not run (RAISES) ·
21770a12e09aba7f - assert_rank helper · level 0 · unverified ·
7d55cef5a5d36394 - attention_layer model · level 0 · unverified ·
e2b4886c5ce3dcec - dropout helper · level 1 · ran; the contract check could not run ·
b934a5a18a8186cb - layer_norm helper · level 0 · unverified ·
fedeb6766bad1fad - reshape_from_matrix helper · level 0 · unverified ·
27c0765ef6b89ca9 - reshape_to_matrix helper · level 1 · ran · our draft was wrong ·
7b84f3e6a96584b4
harvested Assembly for BERT (graph method: BERT). 8 bricks; individually on a fixture: 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 6 unverified. The assembly has not been run end-to-end.
one of 115 siblings
- TransformerModel entry · level 0 · unverified ·
946cd24442973489 - TransformerLayer model · level 0 · unverified ·
07f05b67a5afe0dd - TransformerAttention model · level 0 · unverified ·
207b46bd316070c6 - TransformerIntermediate model · level 1 · ran ·
9be5a608b03add6a - TransformerOutput model · level 0 · unverified ·
03a3d15424bea269 - TransformerSelfAttention model · level 0 · unverified ·
68634f7940230fc2 - TransformerSelfOutput model · level 0 · unverified ·
515b61ea2a383523 - gelu helper · level 1 · ran · honoured contract ·
409ea40d28f93c7e
harvested Assembly for BERT (graph method: BERT). 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified. The assembly has not been run end-to-end.
one of 115 siblings
- BertModel entry · level 0 · unverified ·
73c88a124156227a - create_attention_mask_from_input_mask model · level 0 · unverified ·
ecf19688a7eb0d04 - create_initializer helper · level 0 · unverified ·
e3981aa2fadfb2eb - embedding_lookup model · level 0 · unverified ·
fd655b6f6e2908d6 - embedding_postprocessor model · level 0 · unverified ·
9c69503daf39b4c9 - get_activation helper · level 1 · ran · our draft was wrong ·
5681f7dd9b6e3679 - get_shape_list helper · level 1 · ran · our draft was wrong ·
5a657fd9d0832b35 - transformer_model model · level 0 · unverified ·
5e82334665dedf36 - layer_norm_and_dropout model · level 0 · unverified ·
15f847b95346c6d2 - gelu helper · level 0 · unverified ·
ecab128238ebf253 - assert_rank helper · level 0 · unverified ·
3626c55dff7dd429 - attention_layer model · level 0 · unverified ·
d16dcfaecf4647ad - dropout model · level 1 · ran; the contract check could not run (RAISES) ·
873e08c3f15eb1e4 - layer_norm model · level 0 · unverified ·
fedeb6766bad1fad - reshape_from_matrix helper · level 0 · unverified ·
b1f366f8472004a2 - reshape_to_matrix helper · level 1 · ran · our draft was wrong ·
7b84f3e6a96584b4
harvested Assembly for BERT (graph method: BERT). 10 bricks; individually on a fixture: 9 ran (of which 7 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified. The assembly has not been run end-to-end.
one of 115 siblings
- BERT entry · level 0 · unverified ·
6674cc6102e96505 - BERTEmbedding model · level 1 · ran ·
a42a5dbeebdf39e3 - TransformerBlock model · level 1 · ran ·
7e19140b483ea0b1 - PositionalEmbedding helper · level 1 · ran ·
d16f303823d8ee5a - SegmentEmbedding helper · level 1 · ran ·
ec4cc2e0c00b6449 - TokenEmbedding helper · level 1 · ran ·
6ac09cf3d33d9991 - MultiHeadedAttention model · level 1 · ran ·
8708bfceac69760b - PositionwiseFeedForward model · level 1 · ran ·
708bd2d8037a185a - SublayerConnection helper · level 1 · ran ·
740ab852bb4af958 - Attention helper · level 1 · ran ·
fa24061b6aade569
- BertModel · 1f176c1076d7b8c4 · 16 bricks; individually on a fixture: 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 11 unverified · The assembly has not been run end-to-end · assemblies[12] in the JSON twin
- Bert · 20a4fe0ae39f0c9d · 2 bricks; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[13] in the JSON twin
- BERT · 21139167bf267d6b · 6 bricks; individually on a fixture: 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified; every one of the 4 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[14] in the JSON twin
- BERTEncoder · 22ecc70ce8ca4689 · 3 bricks; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified; the one sample that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[15] in the JSON twin
- Transformer · 27c10e53e7808832 · 8 bricks; individually on a fixture: 4 ran (of which 2 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified · The assembly has not been run end-to-end · assemblies[16] in the JSON twin
- BertModel · 28a7cac9ffcc4409 · 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[17] in the JSON twin
- recreate_model · 291e3d832ac1612e · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[18] in the JSON twin
- BertModel · 2aa35fb9722dbfb4 · 23 bricks; individually on a fixture: 8 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 15 unverified · The assembly has not been run end-to-end · assemblies[19] in the JSON twin
- BertModel · 4ef42b8197ced32e · 16 bricks; individually on a fixture: 13 ran (of which 4 constructed an object rather than computing a result; 8 with no instrument failure: 3 honoured, 1 violated, 4 with no contract checked; 5 where Syntology's instrument failed) · 3 unverified · The assembly has not been run end-to-end · assemblies[20] in the JSON twin
- BertModel · 50d69f34ed5defde · 22 bricks; individually on a fixture: 10 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 5 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[21] in the JSON twin
- BertModel · 51ad5c70bbeeee8a · 16 bricks; individually on a fixture: 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 11 unverified · The assembly has not been run end-to-end · assemblies[22] in the JSON twin
- BertModel · 5423c410ccd982d6 · 16 bricks; individually on a fixture: 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 10 unverified · The assembly has not been run end-to-end · assemblies[23] in the JSON twin
- BertQAService · 545140491ce51611 · 1 brick; individually on a fixture: 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[24] in the JSON twin
- BertModel · 5590e763202219e4 · 24 bricks; individually on a fixture: 9 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 4 where Syntology's instrument failed) · 15 unverified · The assembly has not been run end-to-end · assemblies[25] in the JSON twin
- BertModel · 5a8e48d42310e3e6 · 22 bricks; individually on a fixture: 10 ran (of which 3 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 5 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[26] in the JSON twin
- BertModel · bcf3708d0745989f · 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[27] in the JSON twin
- BERTModel · bcfaf2692d5b1025 · 2 bricks; individually on a fixture: 0 ran · 2 unverified · The assembly has not been run end-to-end · assemblies[28] in the JSON twin
- BertModel · bd595267f71c2059 · 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[29] in the JSON twin
- CondBertRewriter · bd77b5f169d8988a · 3 bricks; individually on a fixture: 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[30] in the JSON twin
- BERT · c13a19661fc04682 · 4 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[31] in the JSON twin
- BertModel · c3c36791034d397d · 16 bricks; individually on a fixture: 12 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 3 honoured, 0 violated, 0 with no contract checked; 9 where Syntology's instrument failed) · 4 unverified · The assembly has not been run end-to-end · assemblies[32] in the JSON twin
- BERT · c612e31643705391 · 2 bricks; individually on a fixture: 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[33] in the JSON twin
- BertModel · c9da0f37a1e56f94 · 16 bricks; individually on a fixture: 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 11 unverified · The assembly has not been run end-to-end · assemblies[34] in the JSON twin
- mask_tokens · c9ff3f6195f84e5a · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[35] in the JSON twin
- BertTokenizerX · d0df2b684a232509 · 1 brick; individually on a fixture: 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[36] in the JSON twin
- BERTGRUSentiment · d2262504200a1910 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[37] in the JSON twin
- get_topk_predictions · d2d6efc898d652ba · 1 brick; individually on a fixture: 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[38] in the JSON twin
- create_masked_lm_predictions · d46f849385da3068 · 1 brick; individually on a fixture: 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[39] in the JSON twin
- PLMEncoder · d7ce04913fcbc492 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[40] in the JSON twin
- BertContextEmbedder · d867a56bdc18be8b · 2 bricks; individually on a fixture: 0 ran · 2 unverified · The assembly has not been run end-to-end · assemblies[41] in the JSON twin
- MockingjayModel · d9849293b03417a1 · 13 bricks; individually on a fixture: 6 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 7 unverified · The assembly has not been run end-to-end · assemblies[42] in the JSON twin
- SentimentClassifier · dcbfdf175d477d7b · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[43] in the JSON twin
- BertModel · dd4b7130d4fb04bb · 3 bricks; individually on a fixture: 0 ran · 3 unverified · The assembly has not been run end-to-end · assemblies[44] in the JSON twin
- Bert · dddfc7b3f6a95bf2 · 5 bricks; individually on a fixture: 4 ran (of which 1 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[45] in the JSON twin
- BERTDataset · e7f6df713a8aadb2 · 6 bricks; individually on a fixture: 4 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified · The assembly has not been run end-to-end · assemblies[46] in the JSON twin
- BertModel · ed55ec905a27c7f2 · 27 bricks; individually on a fixture: 9 ran (of which 3 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 4 where Syntology's instrument failed) · 18 unverified · The assembly has not been run end-to-end · assemblies[47] in the JSON twin
- BertForMaskedLMOptimized · eddbd190bbe091e6 · 1 brick; individually on a fixture: 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[48] in the JSON twin
- BertModel · ee60c4256285fb9a · 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[49] in the JSON twin
- BertModel · efa8e8e0ef8b0d2d · 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[50] in the JSON twin
- BertCRF · f0ef0840dc4e4a0d · 2 bricks; individually on a fixture: 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[51] in the JSON twin
- BertModel · f16ead74399b5d0b · 8 bricks; individually on a fixture: 7 ran (of which 4 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[52] in the JSON twin
- Bert · f291cd6d303fd2d5 · 1 brick; individually on a fixture: 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[53] in the JSON twin
- BERT · f3a5cf0773c82d9e · 2 bricks; individually on a fixture: 0 ran · 2 unverified · The assembly has not been run end-to-end · assemblies[54] in the JSON twin
- BertModel · f3d5abcb8996497d · 16 bricks; individually on a fixture: 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 11 unverified · The assembly has not been run end-to-end · assemblies[55] in the JSON twin
- BertModel · f46dc6af1458c5f5 · 16 bricks; individually on a fixture: 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 11 unverified · The assembly has not been run end-to-end · assemblies[56] in the JSON twin
- BertForMultiLabelSequenceClassification · f7c0b751dc9a907e · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[57] in the JSON twin
- BertModel · fa835e45eaf0b4af · 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[58] in the JSON twin
- BertModel · fbf6bdff4c1ee8ce · 23 bricks; individually on a fixture: 14 ran (of which 3 constructed an object rather than computing a result; 9 with no instrument failure: 1 honoured, 0 violated, 8 with no contract checked; 5 where Syntology's instrument failed) · 9 unverified · The assembly has not been run end-to-end · assemblies[59] in the JSON twin
- Encoder · ff238dcf0e792fa1 · 7 bricks; individually on a fixture: 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 3 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[60] in the JSON twin
- BertModel · 5b17983dea05723d · 22 bricks; individually on a fixture: 10 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 5 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[61] in the JSON twin
- BertModel · 5fb96005a4170125 · 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[62] in the JSON twin
- Bertencoder · 61e81a7823c53047 · 1 brick; individually on a fixture: 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[63] in the JSON twin
- BertModel · 62bab323eefa8bcc · 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[64] in the JSON twin
- BertModel · 6b97a9f0220eec1f · 17 bricks; individually on a fixture: 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[65] in the JSON twin
- BertDataset · 737e9466ad6e2df8 · 4 bricks; individually on a fixture: 3 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[66] in the JSON twin
- _build_bert · 7ab4473560479ce9 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[67] in the JSON twin
- BertModel · 7d22356c06265f1a · 27 bricks; individually on a fixture: 12 ran (of which 5 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 7 where Syntology's instrument failed) · 15 unverified · The assembly has not been run end-to-end · assemblies[68] in the JSON twin
- BertSelfAttention · 7d9faca373ab7334 · 1 brick; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[69] in the JSON twin
- Encoder · 7f8946df8f77313c · 5 bricks; individually on a fixture: 5 ran (of which 3 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 1 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[70] in the JSON twin
- BertModel · 867780212a0e6e81 · 18 bricks; individually on a fixture: 6 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[71] in the JSON twin
- BERT · 8842305e44f87271 · 5 bricks; individually on a fixture: 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified · The assembly has not been run end-to-end · assemblies[72] in the JSON twin
- bert_tokens · 88f2a797319f9dc5 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[73] in the JSON twin
- BERT · 8a438add96704023 · 9 bricks; individually on a fixture: 7 ran (of which 4 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified · The assembly has not been run end-to-end · assemblies[74] in the JSON twin
- BertModel · 2d3dc26a3e19bbb2 · 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[75] in the JSON twin
- BertLayer · 2efdc6b50487299c · 8 bricks; individually on a fixture: 6 ran (of which 2 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified · The assembly has not been run end-to-end · assemblies[76] in the JSON twin
- build_model · 30e372412c13a481 · 2 bricks; individually on a fixture: 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[77] in the JSON twin
- BertModel · 31e2d80a4d1b2075 · 16 bricks; individually on a fixture: 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 11 unverified · The assembly has not been run end-to-end · assemblies[78] in the JSON twin
- FullTokenizer · 31fe56dd0bb81949 · 10 bricks; individually on a fixture: 9 ran (of which 2 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 3 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[79] in the JSON twin
- BertModel · 333e53944ff2d0dd · 23 bricks; individually on a fixture: 8 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 15 unverified · The assembly has not been run end-to-end · assemblies[80] in the JSON twin
- MT_BERT · 34c88b723c985521 · 6 bricks; individually on a fixture: 4 ran (of which 3 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified · The assembly has not been run end-to-end · assemblies[81] in the JSON twin
- BertModel4Mix · 34dcd5cba3e3a791 · 2 bricks; individually on a fixture: 0 ran · 2 unverified · The assembly has not been run end-to-end · assemblies[82] in the JSON twin
- BERT · 3700b2d52162e5b7 · 8 bricks; individually on a fixture: 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 6 unverified · The assembly has not been run end-to-end · assemblies[83] in the JSON twin
- BertModel · 3968314100516660 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[84] in the JSON twin
- Transformer · 3b09c9b847ab4fe2 · 8 bricks; individually on a fixture: 5 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified · The assembly has not been run end-to-end · assemblies[85] in the JSON twin
- BertModel · 3baf2104f9e13ce3 · 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[86] in the JSON twin
- batcher · 3d3ad233b7fdc437 · 2 bricks; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[87] in the JSON twin
- Bert_base · 3eab67096e70a1d6 · 2 bricks; individually on a fixture: 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[88] in the JSON twin
- BERTify · 48067a9b8cb653cc · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[89] in the JSON twin
- Pretraining_Config · 48e50fa4bcfed0b3 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[90] in the JSON twin
- Bert · 498c11b591dfce4c · 2 bricks; individually on a fixture: 0 ran · 2 unverified · The assembly has not been run end-to-end · assemblies[91] in the JSON twin
- BertModel · 8d29ac68cf362aea · 16 bricks; individually on a fixture: 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 11 unverified · The assembly has not been run end-to-end · assemblies[92] in the JSON twin
- BertModel · 9038c0768ea0b644 · 23 bricks; individually on a fixture: 14 ran (of which 5 constructed an object rather than computing a result; 11 with no instrument failure: 1 honoured, 0 violated, 10 with no contract checked; 3 where Syntology's instrument failed) · 9 unverified · The assembly has not been run end-to-end · assemblies[93] in the JSON twin
- BertModel · 92b94b1e4f02fc99 · 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[94] in the JSON twin
- BertModel · 931465ad09d2d346 · 27 bricks; individually on a fixture: 12 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 7 where Syntology's instrument failed) · 15 unverified · The assembly has not been run end-to-end · assemblies[95] in the JSON twin
- BertModel · 9378352c89e4975f · 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[96] in the JSON twin
- BertModel4Pretrain · 9748f94b19ff3476 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[97] in the JSON twin
- Transformer · 9c074487ef36cc0f · 9 bricks; individually on a fixture: 9 ran (of which 4 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 0 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[98] in the JSON twin
- SBERT · 9cff77ea06a019dd · 6 bricks; individually on a fixture: 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified; every one of the 2 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[99] in the JSON twin
- BertModel · 9ee34204eebd6ae0 · 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[100] in the JSON twin
- LineBertModel · a3079b80110bb7f9 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[101] in the JSON twin
- MultiheadAttention · a690e48296a35d1a · 1 brick; individually on a fixture: 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[102] in the JSON twin
- BertModel · a739d9d2304c0555 · 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[103] in the JSON twin
- BERTCollaborativeAdapter · a7593d41dc80fb00 · 3 bricks; individually on a fixture: 2 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[104] in the JSON twin
- DoubleBERT · a7e68b858d6d57c0 · 2 bricks; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[105] in the JSON twin
- BertModel · aa204ca91329daa5 · 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[106] in the JSON twin
- BERTEmbedding · acbfa9eca3eff610 · 3 bricks; individually on a fixture: 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 3 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[107] in the JSON twin
- BertModel · ae1f565a75599d1a · 15 bricks; individually on a fixture: 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 10 unverified · The assembly has not been run end-to-end · assemblies[108] in the JSON twin
- BatchGeneratorForBERT · ae902f5f3fa666ae · 1 brick; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[109] in the JSON twin
- predictions · b26a4a0bd17fa4d4 · 3 bricks; individually on a fixture: 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[110] in the JSON twin
- BertModel · b6e725b818b8fe00 · 16 bricks; individually on a fixture: 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 11 unverified · The assembly has not been run end-to-end · assemblies[111] in the JSON twin
- BertModel · b8e8e3d2543a3033 · 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[112] in the JSON twin
- BERTDataset · ba2f704aff0350dc · 6 bricks; individually on a fixture: 4 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified · The assembly has not been run end-to-end · assemblies[113] in the JSON twin
- BertModel · ba978597a88b7b65 · 16 bricks; individually on a fixture: 7 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 6 where Syntology's instrument failed) · 9 unverified · The assembly has not been run end-to-end · assemblies[114] in the JSON twin
Each brick ends with its code_sha256, Syntology's identity for that exact code; click one to copy the get_code call that returns it. For agents, on Syntology's MCP service: assembly(arxiv_id="1810.04805") returns these assemblies with each brick's role and wiring (how to connect).
Tasks
Datasets
Introduced by this paper, per the archive.
Results from the paper archive 2025-07-28
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Methods
Introduced by this paper: BERT, mBERT
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections