Papers › PGTask: Introducing the Task of Profile Generation from Dialogues

PGTask: Introducing the Task of Profile Generation from Dialogues

13 Apr 2023arXiv:2304.06634archive 2025-07-28

Rui Ribeiro, Joao P. Carvalho, Luísa Coheur

Recent approaches have attempted to personalize dialogue systems by leveraging profile information into models. However, this knowledge is scarce and difficult to obtain, which makes the extraction/generation of profile information from dialogues a fundamental asset. To surpass this limitation, we introduce the Profile Generation Task (PGTask). We contribute with a new dataset for this problem, comprising profile sentences aligned with related utterances, extracted from a corpus of dialogues. Furthermore, using state-of-the-art methods, we provide a benchmark for profile generation on this novel dataset. Our experiments disclose the challenges of profile generation, and we hope that this introduces a new research direction.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

ruinunca/PGTask officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Profile Generation

Datasets

Introduced by this paper, per the archive.

PGDataset

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Profile Generation PGDataset gpt2-small BLEU-1 61.30 #1 of 2 Archive leaderboard report
Profile Generation PGDataset gpt2-small BLEU-2 32.3 #1 of 2 Archive leaderboard report
Profile Generation PGDataset gpt2-small BLEU-3 20.62 #1 of 2 Archive leaderboard report
Profile Generation PGDataset gpt2-small BLEU-4 9.44 #1 of 2 Archive leaderboard report
Profile Generation PGDataset gpt2-small BertScore 94.39 #1 of 2 Archive leaderboard report
Profile Generation PGDataset gpt2-small ROUGE-1 50.07 #1 of 2 Archive leaderboard report
Profile Generation PGDataset gpt2-small ROUGE-2 28.31 #1 of 2 Archive leaderboard report
Profile Generation PGDataset gpt2-small ROUGE-L 50.00 #1 of 2 Archive leaderboard report
Profile Generation PGDataset gpt2-medium BLEU-1 59.31 #2 of 2 Archive leaderboard report
Profile Generation PGDataset gpt2-medium BLEU-2 25.94 #2 of 2 Archive leaderboard report
Profile Generation PGDataset gpt2-medium BLEU-3 15.3 #2 of 2 Archive leaderboard report
Profile Generation PGDataset gpt2-medium BLEU-4 9.17 #2 of 2 Archive leaderboard report
Profile Generation PGDataset gpt2-medium BertScore 94.76 #2 of 2 Archive leaderboard report
Profile Generation PGDataset gpt2-medium ROUGE-1 46.32 #2 of 2 Archive leaderboard report
Profile Generation PGDataset gpt2-medium ROUGE-2 24.14 #2 of 2 Archive leaderboard report
Profile Generation PGDataset gpt2-medium ROUGE-L 45.88 #2 of 2 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

AdamAttentionAttention DropoutBPECosine AnnealingDense ConnectionsDiscriminative Fine-TuningDropoutGPT-2Layer NormalizationLinear LayerLinear Warmup With Cosine AnnealingMulti-Head AttentionResidual ConnectionSoftmaxWeight Decay

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections