Datasets › Discovery
Discovery
The Discovery datasets consists of adjacent sentence pairs (s1,s2) with a discourse marker (y) that occurred at the beginning of s2. They were extracted from the depcc web corpus.
Markers prediction can be used in order to train a sentence encoders. Discourse markers can be considered as noisy labels for various semantic tasks, such as entailment (y=therefore), subjectivity analysis (y=personally) or sentiment analysis (y=sadly), similarity (y=similarly), typicality, (y=curiously) ...
The specificity of this dataset is the diversity of the markers, since previously used data used only ~10 imbalanced classes. The author of the dataset provide:
- a list of the 174 discourse markers
- a Base version of the dataset with 1.74 million pairs (10k examples per marker)
- a Big version with 3.4 million pairs
- a Hard version with 1.74 million pairs where the connective couldn't be predicted with a fastText linear model
Source: GitHub
Benchmarks archive 2025-07-28
All 1 leaderboard whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.
| First row (archive order) | Paper | Code | ||||
|---|---|---|---|---|---|---|
| Relation Classification | Discovery | BERT 1:1 Accuracy 20.6 | Mining Discourse Markers for Unsupervised Sentence... | synapse-developpement/Discovery | 1 | Compare |
Papers archive 2025-07-28
1 shown of 1 paper with a leaderboard row on this dataset's benchmarks, newest first. The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset; the archive's count for this dataset is 10. The Syntology column is from Syntology's graph (read 2026-09-24), stated per sample; it is not part of any archive number.
| Date | Samples run Syntology | |||
|---|---|---|---|---|
| Mining Discourse Markers for Unsupervised Sentence Representation Learning | 1 | 1 | 28 Mar 2019 | not harvested |
Dataset loaders archive 2025-07-28
3 loaders as listed in the archive; links are outbound and not re-checked here.
Tasks archive 2025-07-28
License archive 2025-07-28
Apache 2.0
Modalities archive 2025-07-28
Languages archive 2025-07-28
Variants archive 2025-07-28
- Discovery
1 variant name, as the archive lists them.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections