{"url":"/sota/workflow-discovery-on-abcd","task":{"name":"Workflow Discovery","url":"/task/workflow-discovery","note":null},"dataset":{"name":"ABCD","url":"/dataset/abcd"},"category":"Natural Language Processing","categories":["Natural Language Processing"],"category_note":null,"description":"Workflow Discovery (WD) was introduced by [Workflow Discovery from Dialogues in the Low Data Regime](https://openreview.net/forum?id=L9othQvPks). WD aims to extract work-flows that have either implicitly or explicitly guided task-oriented dialogues be-\r\ntween two people. Workflows extracted from a conversation consist of a summary of the key actions taken during\r\nthe dialogue. These workflows consist of pre-defined terms for actions and slots when possible, but our approach also al-\r\nlows for actions that are not known to be invented by the model online and used as new steps in the generated work-\r\nflow.","description_from":"task","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","rank":"the archive's row order at snapshot; not re-ranked","rows_end_at":"2025-07-28","rows_withheld_as_spam":0,"metric_values":"the archive's strings, untouched"},"metrics":["In-domain EM","In-domain CE","Cross-domain EM","Cross-domain  CE"],"metric_direction":{"note":"inferred from the metric name only (the archive records no direction); null = not inferred, chart draws points only","by_metric":{"In-domain EM":null,"In-domain CE":null,"Cross-domain EM":null,"Cross-domain  CE":null}},"counts":{"rows":1,"rows_with_code":1,"rows_with_paper_page":1,"rows_dated":1,"rows_using_additional_data":0},"rows":[{"rank_in_archive_order":1,"model":"T5-Large","metrics":{"Cross-domain  CE":"72.3","Cross-domain EM":"51.8","In-domain CE":"75.8","In-domain EM":"55.7"},"uses_additional_data":false,"paper_date":"2022-05-24","paper":"/paper/workflow-discovery-from-dialogues-in-the-low","paper_url":"https://arxiv.org/abs/2205.11690v2","paper_title":"Workflow Discovery from Dialogues in the Low Data Regime","code":"https://github.com/ServiceNow/research-workflow-discovery","n_code_links":1,"syntology":null}],"since_archive":{"present":false,"note":"No Syntology-extracted rows are published in this build."},"syntology":{"read_at":"2026-09-24T18:15:14+00:00","claim":"Per row: N of M harvested code samples from that row's paper executed on a synthesized fixture; the other M-N are unverified. Not a reproduction of the row's number; not a correctness claim. n_pointer_only_licence counts samples the site points at rather than redistributes (a licence axis, independent of ran/unverified).","rows_with_graph_line":0,"rows_with_any_sample_ran":0,"distinct_papers_with_graph_line":0,"distinct_papers_with_any_sample_ran":0,"samples_over_distinct_papers":{"n_ran":0,"n_unverified":0,"n_samples":0,"n_pointer_only_licence":0,"note":"each paper (arXiv id) counted once, however many rows it is behind; this is the page-level figure"},"samples_row_weighted":{"n_ran":0,"n_unverified":0,"n_samples":0,"n_pointer_only_licence":0,"note":"row-weighted: a paper behind several rows is counted once per row; inflated relative to samples_over_distinct_papers by design, kept for readers summing the per-row syntology blocks"}}}