Papers › Generating Sequences With Recurrent Neural Networks

Generating Sequences With Recurrent Neural Networks

4 Aug 2013arXiv:1308.0850archive 2025-07-28

Alex Graves

This paper shows how Long Short-term Memory recurrent neural networks can be used to generate complex sequences with long-range structure, simply by predicting one data point at a time. The approach is demonstrated for text (where the data are discrete) and online handwriting (where the data are real-valued). It is then extended to handwriting synthesis by allowing the network to condition its predictions on a text sequence. The resulting system is able to generate highly realistic cursive handwriting in a wide variety of styles.

PaperPDFCodeCode Syntology ran

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, Syntology's MCP tool lists every function and class Syntology harvested from this paper and whether it ran (how to connect): get_harvested_code_for_paper(arxiv_id="1308.0850")

Code

Syntology Ran 7 of 37 code samples harvested from 8 repositories linked to this paper; 30 have no recorded run. Of those that ran: 4 ran · honoured contract; 2 ran · our draft was wrong; 1 ran · fixture could not drive it.

By repository: community (archive-listed): 36 samples from 8 repositories, 6 ran; 1 identical to code first harvested elsewhere. The run record, sample by sample. “Ran” means executed on a synthesized input, not that the code is correct or reproduces the paper.

59 repositories listed; official and paper-mentioned ones first.

Akella17/Handwriting_Synthesis mentioned on GitHubtf report
AnesBenmerzoug/Handwriting-Model mentioned on GitHubpytorchMIT report
CongBao/ChatBot mentioned on GitHub report
Julie260/DeepLearningProject mentioned on GitHubpytorch report
KurtAhn/lyrebird mentioned on GitHubtf report
Muiiya/research mentioned on GitHubMIT report
YukiDaSlayer316/R-Tutorial mentioned on GitHub report
ZhouYC627/NN_Compression mentioned on GitHubtf report
adbrebs/handwriting mentioned on GitHub report
adrienphilardeau/Descript-Research-Test mentioned on GitHubnot reachable when probed 2026-09-18 — repositories for recent papers often appear after camera-ready report
altsoph/paranoid_transformer mentioned on GitHubpytorch report
azfarkhoja305/Handwritten-RNNs mentioned on GitHubpytorch report
badhandas/hw_synthesis mentioned on GitHubpytorch report
ciaua/HandwritingPyTorch mentioned on GitHubpytorch report
cody2007/arcane_fortune mentioned on GitHubNOASSERTION report
cpmpercussion/keras-mdn-layer mentioned on GitHubtf report
edwinzhng/handwriting-synthesis mentioned on GitHubtf report
feiwu77777/Handwriting_gen mentioned on GitHubtf report
greydanus/scribe mentioned on GitHubtf report
grzego/handwriting-generation mentioned on GitHubtf report
hardmaru/sketch-rnn-datasets mentioned on GitHubtf report
hardmaru/write-rnn-tensorflow mentioned on GitHubtf report
jolinxql/LSTM mentioned on GitHub report
jparkhill/TensorMol mentioned on GitHubtfGPL-3.0 report
karpathy/char-rnn mentioned on GitHubtorch report
karpathy/makemore mentioned on GitHubpytorch report
kedartatwawadi/NN_compression mentioned on GitHubtfMIT report
larspars/word-rnn mentioned on GitHubtorch report
pnshiralkar/text-to-handwriting mentioned on GitHubtf report
rahul96rajan/text-2-strokes mentioned on GitHubpytorch report
rahulbhalley/Recurrent-Nets-in-Pytorch mentioned on GitHubpytorchMIT report
rahulbhalley/rnns-in-pytorch mentioned on GitHubpytorchMIT report
raymondhs/char-rnn-truecase mentioned on GitHubtorch report
robertknight/textgen mentioned on GitHubpytorch report
rockyyliang/handwrite mentioned on GitHubpytorch report
sjvasquez/handwriting-synthesis mentioned on GitHubtf report
sotelo/scribe mentioned on GitHub report
srikanth-sfu/lyrebird mentioned on GitHubpytorch report
swechhachoudhary/Handwriting-synthesis mentioned on GitHubpytorchMIT report
szcom/rnnlib mentioned on GitHubGPL-3.0 report
vladbataev/handwriting_synthesis mentioned on GitHubpytorch report
yukikongju/R-Tutorial mentioned on GitHub report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

37 samples harvested; 7 ran; 4 honoured the contract we drafted; 30 have no recorded run. Read from Syntology's graph 2026-09-24; that is when this build read the record, not when the samples ran.

4ran · honoured contract
2ran · our draft was wrong
1ran · fixture could not drive it
30unverified

Licence: 4 of the 37 samples are pointer only, meaning Syntology does not serve that copy's text. This page shows no code text for any sample; each one links to its file in the repository.

Harvested from 8 repositories linked to this paper, official or community; each sample names its own and says which. Some samples are identical code Syntology first harvested from another repository; for those, this paper's copy is not located and its licence is not recorded. “Ran” means the sample executed on a synthesized input. It does not mean the output is correct, and nothing here reproduces the paper's results. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself; “our draft was wrong” and “fixture could not drive it” are failures of Syntology's instrument, not of the code.

Each sample ends with its code_sha256, Syntology's identity for that exact code. An agent fetches the stored sample with Syntology's MCP tool get_code(code_sha256="…") (how to connect); click an identity to copy that call.

Repository labels, per sample. official repository: The archive marks this repository official for the paper. named in the paper: The archive records that the paper mentions this repository; it is not marked official. community (archive-listed): In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper. found in paper text by Syntology: Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted. community: Not in the archive's code links for this paper; a community repository Syntology harvested. Samples from a repository marked official are listed first. Licence labels name the repository's licence as recorded at harvest. “Pointer only” means Syntology does not serve that copy's text, for one of four reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; or the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar). Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence label for the reason. File links open the file on GitHub at the default branch, which may have changed since the harvest.

cumsum grzego/handwriting-generation/generate.py community (archive-listed) ran · honoured contract fingerprinted MIT (permissive) · 9bafc68792a5453a · report
gen_training_sequences robertknight/textgen/textgen/__main__.py community (archive-listed) ran · honoured contract no licence file found · pointer only · 232da28e6492c6fb · report
recognize_stroke KurtAhn/lyrebird/models/kurt.py community (archive-listed) ran · our draft was wrong fingerprinted no licence file found · pointer only · 7f57a4dfdc98e7c2 · report
sample robertknight/textgen/textgen/__main__.py community (archive-listed) ran · our draft was wrong no licence file found · pointer only · bdc663f8a518e964 · report
sample grzego/handwriting-generation/generate.py community (archive-listed) ran · honoured contract MIT (permissive) · b5136c243f64693e · report
split_strokes grzego/handwriting-generation/generate.py community (archive-listed) ran · honoured contract MIT (permissive) · 0ff24ae32bac2d32 · report
align Vrushank264/Handwriting-Generation-using-LSTM/utils.py community (archive-listed) unverified MIT (permissive) · 506ea1a5a6aab059 · report
check_eq SamuelNguyen1998/Vietnamese_Handwriting_Recognition/src/data_utils.py community (archive-listed) unverified MIT (permissive) · e7917e9b49503948 · report
compute_nll_loss swechhachoudhary/Handwriting-synthesis/utils/model_utils.py community (archive-listed) unverified MIT (permissive) · c89435a714d679dc · report
create_rnn kedartatwawadi/NN_compression/misc_code/10_char_rnn_gist.py community (archive-listed) unverified MIT (permissive) · 510351eab5eaed0f · report
create_rnn kedartatwawadi/NN_compression/misc_code/11_char_rnn_gist.py community (archive-listed) unverified MIT (permissive) · 59b0e285ea9b27a7 · report
create_rnn kedartatwawadi/NN_compression/misc_code/12_char_rnn_gist.py community (archive-listed) unverified MIT (permissive) · 46bd9f125794535d · report
create_rnn kedartatwawadi/NN_compression/misc_code/15_char_rnn_gist.py community (archive-listed) unverified MIT (permissive) · c642e923cb957119 · report
ctc_lambda_func SamuelNguyen1998/Vietnamese_Handwriting_Recognition/src/loss.py community (archive-listed) unverified MIT (permissive) · 891407c075760cb4 · report
data_denormalization swechhachoudhary/Handwriting-synthesis/utils/data_utils.py community (archive-listed) unverified MIT (permissive) · 8f5f6f10d9df29f1 · report
encode_ascii Vrushank264/Handwriting-Generation-using-LSTM/utils.py community (archive-listed) unverified MIT (permissive) · d0ea3aaa2f0cb4d7 · report
entropy_iid kedartatwawadi/NN_compression/src/data_generation_scripts/generate_lagged_fibonacci.py community (archive-listed) unverified MIT (permissive) · 78b673d1702aa8fc · report
filter_line_strokes_and_transcriptions AnesBenmerzoug/Handwriting-Model/src/handwriting_generator/utils.py community (archive-listed) unverified MIT (permissive) · 316f20cd174551b7 · report
get_logger SamuelNguyen1998/Vietnamese_Handwriting_Recognition/src/log.py community (archive-listed) unverified MIT (permissive) · ce47adec051d5431 · report
labels_to_text SamuelNguyen1998/Vietnamese_Handwriting_Recognition/src/utils.py community (archive-listed) unverified MIT (permissive) · 8a9c5ba6da1be290 · report
load_line_strokes AnesBenmerzoug/Handwriting-Model/src/handwriting_generator/utils.py community (archive-listed) unverified MIT (permissive) · b15244e710c02e4a · report
load_transcriptions AnesBenmerzoug/Handwriting-Model/src/handwriting_generator/utils.py community (archive-listed) unverified MIT (permissive) · 1430cb6d9a3f833d · report
mixture_of_bivariate_normal_nll Vrushank264/Handwriting-Generation-using-LSTM/functions.py community (archive-listed) unverified MIT (permissive) · 0858be3fdf9eb3de · report
mixture_of_bivariate_normal_sample Vrushank264/Handwriting-Generation-using-LSTM/functions.py community (archive-listed) unverified MIT (permissive) · de459a9fb9e0a962 · report
path_string_to_stroke swechhachoudhary/Handwriting-synthesis/app/xml_parser.py community (archive-listed) unverified MIT (permissive) · 453cf42813afb445 · report
preprocess_batch Vrushank264/Handwriting-Generation-using-LSTM/data.py community (archive-listed) unverified MIT (permissive) · c794567624eca063 · report
scale SamuelNguyen1998/Vietnamese_Handwriting_Recognition/src/data_utils.py community (archive-listed) unverified MIT (permissive) · a43e3c26a372625d · report
skew Vrushank264/Handwriting-Generation-using-LSTM/utils.py community (archive-listed) unverified MIT (permissive) · 57345eef39f87d96 · report
stable_softmax swechhachoudhary/Handwriting-synthesis/utils/model_utils.py community (archive-listed) unverified MIT (permissive) · 40eb6d67a6e160c6 · report
svg_xml_parser swechhachoudhary/Handwriting-synthesis/app/xml_parser.py community (archive-listed) unverified MIT (permissive) · f84bc9f82b0a9658 · report
text_to_labels SamuelNguyen1998/Vietnamese_Handwriting_Recognition/src/utils.py community (archive-listed) unverified MIT (permissive) · 0c9fb7323dbd8b8f · report
train_offset_normalization swechhachoudhary/Handwriting-synthesis/utils/data_utils.py community (archive-listed) unverified MIT (permissive) · e25dad2e1379fe88 · report
valid_offset_normalization swechhachoudhary/Handwriting-synthesis/utils/data_utils.py community (archive-listed) unverified MIT (permissive) · 3b394d43bf805dbc · report
vocab_decode kedartatwawadi/NN_compression/misc_code/10_char_rnn_gist.py community (archive-listed) unverified MIT (permissive) · cd578a493dc93a37 · report
vocab_decode kedartatwawadi/NN_compression/misc_code/13_char_rnn_gist.py community (archive-listed) unverified MIT (permissive) · 2d6be2ab08f58d21 · report
vocab_encode kedartatwawadi/NN_compression/misc_code/10_char_rnn_gist.py community (archive-listed) unverified MIT (permissive) · 3eb3077a0bd2904e · report
get_pi_idx identical code first harvested elsewhere ran · fixture could not drive it fingerprinted licence of this copy not recorded · 7bb85eb640efb52d · report

Tasks

Language ModellingText Generation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Language Modelling enwik8 LSTM (7 layers) Bit per Character (BPC) 1.67 #41 of 42 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections