accuracy
accuracy: 8 implementations from 7 papers ran on one shared input (census 2026-09-22, battery b986f7e04d79); they produced 7 distinct outputs across 6 buckets, one shared input per bucket.
Identical values to six decimals (the recorded digest) on the shared input are agreement on those inputs, not equivalence. Implementations are compared only within one bucket, the positional (rank, kind, dtype) of each array argument; the argument name is not part of the key because the harness draws the shared array from (rank, kind) and casts it to the dtype, whatever the name; each bucket's shared input is fixed by that key, so members of one bucket saw bitwise-identical inputs under their own scalar arguments. A cluster is the set of members whose recorded output digest is identical. Nothing here says which computation a paper's method intended, and nothing reproduces a paper's results.
Not compared, and not in the tables or the counts above:
- 30 more implementations of this name were examined but did not run on the shared input (RuntimeError 25, ValueError 4, AssertionError 1).
- 6 more implementations from 6 papers took no array argument and ran only on their own fixture arguments; no shared input existed for them, so they are not compared (on 6 the recorded shared-output digest is the own-fixture digest).
- Every compared output was digested.
Bucket 1 of 6: arg 1: rank 2, kind int, dtype int64 · arg 2: rank 2, kind int, dtype int64
3 implementations from 2 papers share this bucket (rank, kind, dtype of each array argument, positional; each member's recorded signature, argument name included, is shown under it); 2 distinct outputs, largest cluster first. Values are the first 8 of the recorded output, flattened.
| Cluster (same digest to six decimals) | Members | Shared output on this bucket's input |
|---|---|---|
| 2 implementations 1 paper af5570f5a181 recorded values identical |
scripts/meta_ren.py 18922b51 recorded true_label:2/int/int64, pred_label:2/int/int64 scripts/batch_rewgt.py f5c0c242 recorded true_label:2/int/int64, pred_label:2/int/int64 |
[0] shape [] · float64 · float |
| 1 implementation 1 paper 6c3c396ed6b5 |
eval_segmentation.py 9f4da55b recorded y_true:2/int/int64, y_pred:2/int/int64; ignore_labels=[2] |
[1] shape [] · float64 · float |
Bucket 2 of 6: arg 1: rank 1, kind float, dtype float32 · arg 2: rank 1, kind float, dtype float32
1 implementation from 1 paper share this bucket (rank, kind, dtype of each array argument, positional; each member's recorded signature, argument name included, is shown under it); 1 distinct output, largest cluster first. Values are the first 8 of the recorded output, flattened.
| Cluster (same digest to six decimals) | Members | Shared output on this bucket's input |
|---|---|---|
| 1 implementation 1 paper af5570f5a181 |
main_rfr.py ec011973 recorded output:1/float/float32, labels:1/float/float32 |
[0] shape [] · float64 · float |
Bucket 3 of 6: arg 1: rank 1, kind float, dtype float64 · arg 2: rank 1, kind float, dtype float32
1 implementation from 1 paper share this bucket (rank, kind, dtype of each array argument, positional; each member's recorded signature, argument name included, is shown under it); 1 distinct output, largest cluster first. Values are the first 8 of the recorded output, flattened.
| Cluster (same digest to six decimals) | Members | Shared output on this bucket's input |
|---|---|---|
| 1 implementation 1 paper 7f2e387636cd |
bert/run_classifier.py 60df39eb recorded out:1/float/float64, labels:1/float/float32 |
[0.166667] shape [] · float64 |
Bucket 4 of 6: arg 1: rank 1, kind int, dtype int64 · arg 2: rank 1, kind int, dtype int64
1 implementation from 1 paper share this bucket (rank, kind, dtype of each array argument, positional; each member's recorded signature, argument name included, is shown under it); 1 distinct output, largest cluster first. Values are the first 8 of the recorded output, flattened.
| Cluster (same digest to six decimals) | Members | Shared output on this bucket's input |
|---|---|---|
| 1 implementation 1 paper 6c3c396ed6b5 |
algorithms/maml.py 6169b24c recorded y_pred:1/int/int64, y:1/int/int64 |
[1] shape [] · float64 · float |
Bucket 5 of 6: arg 1: rank 2, kind float, dtype float32 · arg 2: rank 2, kind float, dtype float32
1 implementation from 1 paper share this bucket (rank, kind, dtype of each array argument, positional; each member's recorded signature, argument name included, is shown under it); 1 distinct output, largest cluster first. Values are the first 8 of the recorded output, flattened.
| Cluster (same digest to six decimals) | Members | Shared output on this bucket's input |
|---|---|---|
| 1 implementation 1 paper c914e8188e43 |
interpretability/robustness.py f5c1fa1c recorded x1:2/float/float32, x2:2/float/float32; reduce=False |
[1, 1, 1, 1] shape [4] · float32 · Tensor |
Bucket 6 of 6: arg 1: rank 2, kind float, dtype float32
1 implementation from 1 paper share this bucket (rank, kind, dtype of each array argument, positional; each member's recorded signature, argument name included, is shown under it); 1 distinct output, largest cluster first. Values are the first 8 of the recorded output, flattened.
| Cluster (same digest to six decimals) | Members | Shared output on this bucket's input |
|---|---|---|
| 1 implementation 1 paper 109eca6c8335 |
code/epe/EPEExperiment.py 201573db recorded pred:2/float/float32 |
[0.3125] shape [] · float32 · Tensor |
Identical values to six decimals (the recorded digest) on the shared input are agreement on those inputs, not equivalence; where a cluster's members carry recorded values, the largest difference among them is shown under the cluster. Paper titles are the archive's archive 2025-07-28 where the paper is in the archive and the graph's where it was added by Syntology; papers with no page here are shown by their recorded paper id only. A paper count above the implementation count means one implementation (one code sha) is held from several papers' repositories and counts once. Per-sample status, licence and fingerprint records for each paper are on its paper page. JSON twin: /census/accuracy.json.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections