{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/towards-robust-and-semantically-organised","title":"Towards Robust and Semantically Organised Latent Representations for Unsupervised Text Style Transfer","arxiv_id":"2205.02309","date":"2022-05-04","proceeding":"NAACL 2022 7","authors":["Sharan Narasimhan","Suvodip Dey","Maunendra Sankar Desarkar"],"abstract":"Recent studies show that auto-encoder based approaches successfully perform language generation, smooth sentence interpolation, and style transfer over unseen attributes using unlabelled datasets in a zero-shot manner. The latent space geometry of such models is organised well enough to perform on datasets where the style is \"coarse-grained\" i.e. a small fraction of words alone in a sentence are enough to determine the overall style label. A recent study uses a discrete token-based perturbation approach to map \"similar\" sentences (\"similar\" defined by low Levenshtein distance/ high word overlap) close by in latent space. This definition of \"similarity\" does not look into the underlying nuances of the constituent words while mapping latent space neighbourhoods and therefore fails to recognise sentences with different style-based semantics while mapping latent neighbourhoods. We introduce EPAAEs (Embedding Perturbed Adversarial AutoEncoders) which completes this perturbation model, by adding a finely adjustable noise component on the continuous embeddings space. We empirically show that this (a) produces a better organised latent space that clusters stylistically similar sentences together, (b) performs best on a diverse set of text style transfer tasks than similar denoising-inspired baselines, and (c) is capable of fine-grained control of Style Transfer strength. We also extend the text style transfer tasks to NLI datasets and show that these more complex definitions of style are learned best by EPAAE. To the best of our knowledge, extending style transfer to NLI tasks has not been explored before.","url_abs":"https://arxiv.org/abs/2205.02309v1","url_pdf":"https://arxiv.org/pdf/2205.02309v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"towards-robust-and-semantically-organised","repo_url":"https://github.com/sharan21/epaae","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"denoising","task_name":"Denoising"},{"task_slug":"sentence","task_name":"Sentence"},{"task_slug":"style-transfer","task_name":"Style Transfer"},{"task_slug":"text-generation","task_name":"Text Generation"},{"task_slug":"text-style-transfoer","task_name":"Text Style Transfer"},{"task_slug":"unsupervised-text-style-transfer","task_name":"Unsupervised Text Style Transfer"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2205.02309","atlas_url":"https://app.syntology.ai/?focus=2205.02309","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2205.02309"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/sharan21/EPAAE","reach":null}],"summary":{"ran":1,"ran_honours":3,"ran_draft_wrong":6,"ran_fixture":1,"unverified":3},"by_repo_kind":{"official":{"samples":14,"ran":11,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":14,"samples":[{"code_sha256_prefix":"bb9989b32e830301","entry":"TextModel","repo":"sharan21/EPAAE","repo_kind":"official","path":"model.py","file_url":"https://github.com/sharan21/EPAAE/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"bb9989b32e830301"}},{"code_sha256_prefix":"fde366f6463eb000","entry":"get_anneal_weight","repo":"sharan21/EPAAE","repo_kind":"official","path":"model.py","file_url":"https://github.com/sharan21/EPAAE/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fde366f6463eb000"}},{"code_sha256_prefix":"2c5ac586d6bbd26e","entry":"get_glove","repo":"sharan21/EPAAE","repo_kind":"official","path":"model.py","file_url":"https://github.com/sharan21/EPAAE/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2c5ac586d6bbd26e"}},{"code_sha256_prefix":"f33b25fbebcd0a54","entry":"load_glove","repo":"sharan21/EPAAE","repo_kind":"official","path":"model.py","file_url":"https://github.com/sharan21/EPAAE/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f33b25fbebcd0a54"}},{"code_sha256_prefix":"4ebc241db4d9569d","entry":"log_prob","repo":"sharan21/EPAAE","repo_kind":"official","path":"model.py","file_url":"https://github.com/sharan21/EPAAE/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4ebc241db4d9569d"}},{"code_sha256_prefix":"804024b3e7ec5ab5","entry":"noisy","repo":"sharan21/EPAAE","repo_kind":"official","path":"model.py","file_url":"https://github.com/sharan21/EPAAE/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"804024b3e7ec5ab5"}},{"code_sha256_prefix":"447585e6fedec167","entry":"reparameterize","repo":"sharan21/EPAAE","repo_kind":"official","path":"model.py","file_url":"https://github.com/sharan21/EPAAE/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"447585e6fedec167"}},{"code_sha256_prefix":"17919456d86a482f","entry":"word_blank","repo":"sharan21/EPAAE","repo_kind":"official","path":"model.py","file_url":"https://github.com/sharan21/EPAAE/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"17919456d86a482f"}},{"code_sha256_prefix":"29cab3c8d0e924a4","entry":"word_drop","repo":"sharan21/EPAAE","repo_kind":"official","path":"model.py","file_url":"https://github.com/sharan21/EPAAE/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"29cab3c8d0e924a4"}},{"code_sha256_prefix":"bcb6a0a9acc041dd","entry":"word_shuffle","repo":"sharan21/EPAAE","repo_kind":"official","path":"model.py","file_url":"https://github.com/sharan21/EPAAE/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"bcb6a0a9acc041dd"}},{"code_sha256_prefix":"e8d1d1068d437816","entry":"word_substitute","repo":"sharan21/EPAAE","repo_kind":"official","path":"model.py","file_url":"https://github.com/sharan21/EPAAE/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e8d1d1068d437816"}},{"code_sha256_prefix":"ea8ebd56c7715792","entry":"AAE","repo":"sharan21/EPAAE","repo_kind":"official","path":"model.py","file_url":"https://github.com/sharan21/EPAAE/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ea8ebd56c7715792"}},{"code_sha256_prefix":"82c5126ce64df11b","entry":"DAE","repo":"sharan21/EPAAE","repo_kind":"official","path":"model.py","file_url":"https://github.com/sharan21/EPAAE/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"82c5126ce64df11b"}},{"code_sha256_prefix":"7870307065180eaa","entry":"embd_noise","repo":"sharan21/EPAAE","repo_kind":"official","path":"model.py","file_url":"https://github.com/sharan21/EPAAE/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7870307065180eaa"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}