{"url":"/method/criss","slug":"criss","name":"CRISS","full_name":"CRISS","full_name_withheld":false,"description_markdown":"**CRISS**, or **Cross-lingual Retrievial for Iterative Self-Supervised Training (CRISS)**, is a self-supervised learning method for multilingual sequence generation. CRISS is developed based on the finding that the encoder outputs of multilingual denoising autoencoder can be used as language agnostic representation to retrieve parallel sentence pairs, and training the model on these retrieved sentence pairs can further improve its sentence retrieval and translation capabilities in an iterative manner. Using only unlabeled data from many different languages, CRISS iteratively mines for parallel sentences across languages, trains a new better multilingual model using these mined sentence pairs, mines again for better parallel sentences, and repeats.","description_state":"present","introduced_year":null,"introduced_by":{"title":"Cross-lingual Retrieval for Iterative Self-Supervised Training","paper":"/paper/cross-lingual-retrieval-for-iterative-self","first_author":"Chau Tran","n_authors":4,"url_abs":null,"archive_paper_url":"https://paperswithcode.com/paper/cross-lingual-retrieval-for-iterative-self"},"source":{"url":"https://arxiv.org/abs/2006.09526v2","title":"Cross-lingual Retrieval for Iterative Self-Supervised Training","url_on_a_paper_host":true},"code_snippet_url":null,"code_snippet_url_on_a_code_host":false,"categories":[{"area":"General","area_id":"general","collection":"Self-Supervised Learning","url":"/methods/category/self-supervised-learning","pwc_aliases":[]}],"n_papers_tagged":3,"archive_num_papers":3,"papers_newest_first":[{"paper":"/paper/towards-making-the-most-of-multilingual","title":"Towards Making the Most of Multilingual Pretraining for Zero-Shot Neural Machine Translation","date":"2021-10-16","arxiv_id":"2110.08547","n_code_links":1,"syntology":{"ran":2,"of":2,"unverified":0,"pointer_only":2}},{"paper":"/paper/zero-shot-cross-lingual-transfer-of-neural","title":"Zero-shot Cross-lingual Transfer of Neural Machine Translation with Multilingual Pretrained Encoders","date":"2021-04-18","arxiv_id":"2104.08757","n_code_links":1,"syntology":{"ran":1,"of":1,"unverified":0,"pointer_only":1}},{"paper":"/paper/cross-lingual-retrieval-for-iterative-self","title":"Cross-lingual Retrieval for Iterative Self-Supervised Training","date":"2020-06-16","arxiv_id":"2006.09526","n_code_links":1,"syntology":null}],"papers_shown":3,"tasks":[{"task":"/task/machine-translation","name":"Machine Translation","papers":3},{"task":"/task/translation","name":"Translation","papers":3},{"task":"/task/cross-lingual-transfer","name":"Cross-Lingual Transfer","papers":2},{"task":"/task/decoder","name":"Decoder","papers":2},{"task":"/task/nmt","name":"NMT","papers":2},{"task":"/task/abstractive-text-summarization","name":"Abstractive Text Summarization","papers":1},{"task":"/task/cross-lingual-abstractive-summarization","name":"Cross-Lingual Abstractive Summarization","papers":1},{"task":"/task/retrieval","name":"Retrieval","papers":1},{"task":"/task/sentence","name":"Sentence","papers":1},{"task":"/task/sentence-retrieval","name":"Sentence Retrieval","papers":1},{"task":"/task/unsupervised-machine-translation","name":"Unsupervised Machine Translation","papers":1},{"task":"/task/xlm-r","name":"XLM-R","papers":1},{"task":"/task/zero-shot-cross-lingual-transfer","name":"Zero-Shot Cross-Lingual Transfer","papers":1}],"tasks_shown":13,"n_tasks":13,"usage_by_year":[{"year":"2020","papers":1},{"year":"2021","papers":2}],"row_source":"methods_table","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/criss"},"syntology_read_at":"2026-09-24T18:15:14+00:00"}