{"url":"/method/mrnn","slug":"mrnn","name":"mRNN","full_name":"Multiplicative RNN","full_name_withheld":false,"description_markdown":"A **Multiplicative RNN (mRNN)** is a type of recurrent neural network with multiplicative connections. In a standard RNN, the current input $x\\_{t}$ is first transformed via the visible-to-hidden weight matrix $W\\_{hx}$ and then contributes additively to the input for the current hidden state. An mRNN allows the current input (a character in the original example) to affect the hidden state dynamics by determining the entire hidden-to-hidden matrix (which defines the non-linear dynamics) in addition to providing an additive bias.\r\n\r\nTo achieve this goal, the authors modify the RNN so that its hidden-to-hidden weight matrix is a (learned) function of the current input $x\\_{t}$:\r\n\r\n$$ h\\_{t} = \\tanh\\left(W\\_{hx}x\\_{t} + W\\_{hh}^{\\left(x\\_{y}\\right)}h\\_{t-1} + b\\_{h}\\right)$$\r\n\r\n$$ o\\_{t} = W\\_{oh}h\\_{t} + b\\_{o} $$\r\n\r\nThis is the same as the equations for a standard RNN, except that $W\\_{hh}$ is replaced with $W^{(xt)}\\_{hh}$. allowing each input (character) to specify a different hidden-to-hidden weight matrix.","description_state":"present","introduced_year":2011,"introduced_by":{"title":null,"paper":null,"first_author":null,"n_authors":0,"url_abs":null,"archive_paper_url":null},"source":{"url":null,"title":null,"url_on_a_paper_host":false},"code_snippet_url":null,"code_snippet_url_on_a_code_host":false,"categories":[{"area":"Sequential","area_id":"sequential","collection":"Recurrent Neural Networks","url":"/methods/category/recurrent-neural-networks","pwc_aliases":[]}],"n_papers_tagged":1,"archive_num_papers":1,"papers_newest_first":[{"paper":null,"title":"Data-driven Preference Learning Methods for Sorting Problems with Multiple Temporal Criteria","date":"2023-09-22","arxiv_id":"2309.12620","n_code_links":0,"syntology":null}],"papers_shown":1,"tasks":[{"task":"/task/ensemble-learning","name":"Ensemble Learning","papers":1}],"tasks_shown":1,"n_tasks":1,"usage_by_year":[{"year":"2023","papers":1}],"row_source":"methods_table","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/mrnn"},"syntology_read_at":"2026-09-24T18:15:14+00:00"}