{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/position-wise-optimizer-a-nature-inspired","title":"Position-wise optimizer: A nature-inspired optimization algorithm","arxiv_id":"2204.05312","date":"2022-04-11","proceeding":null,"authors":["Amir Valizadeh"],"abstract":"The human nervous system utilizes synaptic plasticity to solve optimization problems. Previous studies have tried to add the plasticity factor to the training process of artificial neural networks, but most of those models require complex external control over the network or complex novel rules. In this manuscript, a novel nature-inspired optimization algorithm is introduced that imitates biological neural plasticity. Furthermore, the model is tested on three datasets and the results are compared with gradient descent optimization.","url_abs":"https://arxiv.org/abs/2204.05312v1","url_pdf":"https://arxiv.org/pdf/2204.05312v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"nature-inspired-optimization-algorithm","task_name":"Nature-Inspired Optimization Algorithm"},{"task_slug":null,"task_name":"Position"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/nature-inspired-optimization-algorithm-on-1","task":"Nature-Inspired Optimization Algorithm","dataset":"CIFAR-10","model":"Position-wise optimizer","rank_in_archive_order":1,"of":2,"metrics":{"training time (s)":"23"},"uses_additional_data":false},{"leaderboard":"/sota/nature-inspired-optimization-algorithm-on-1","task":"Nature-Inspired Optimization Algorithm","dataset":"CIFAR-10","model":"Gradient descent optimizer","rank_in_archive_order":2,"of":2,"metrics":{"training time (s)":"50"},"uses_additional_data":false},{"leaderboard":"/sota/nature-inspired-optimization-algorithm-on","task":"Nature-Inspired Optimization Algorithm","dataset":"MNIST","model":"Position-wise optimizer","rank_in_archive_order":1,"of":2,"metrics":{"training time (s)":"227"},"uses_additional_data":false},{"leaderboard":"/sota/nature-inspired-optimization-algorithm-on","task":"Nature-Inspired Optimization Algorithm","dataset":"MNIST","model":"Gradient descent optimizer","rank_in_archive_order":2,"of":2,"metrics":{"training time (s)":"282"},"uses_additional_data":false}],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}