{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/memory-based-deep-reinforcement-learning-for","title":"Memory-based Deep Reinforcement Learning for Obstacle Avoidance in UAV with Limited Environment Knowledge","arxiv_id":"1811.03307","date":"2018-11-08","proceeding":null,"authors":["Abhik Singla","Sindhu Padakandla","Shalabh Bhatnagar"],"abstract":"This paper presents our method for enabling a UAV quadrotor, equipped with a\nmonocular camera, to autonomously avoid collisions with obstacles in\nunstructured and unknown indoor environments. When compared to obstacle\navoidance in ground vehicular robots, UAV navigation brings in additional\nchallenges because the UAV motion is no more constrained to a well-defined\nindoor ground or street environment. Horizontal structures in indoor and\noutdoor environments like decorative items, furnishings, ceiling fans,\nsign-boards, tree branches etc., also become relevant obstacles unlike those\nfor ground vehicular robots. Thus, methods of obstacle avoidance developed for\nground robots are clearly inadequate for UAV navigation. Current control\nmethods using monocular images for UAV obstacle avoidance are heavily dependent\non environment information. These controllers do not fully retain and utilize\nthe extensively available information about the ambient environment for\ndecision making. We propose a deep reinforcement learning based method for UAV\nobstacle avoidance (OA) and autonomous exploration which is capable of doing\nexactly the same. The crucial idea in our method is the concept of partial\nobservability and how UAVs can retain relevant information about the\nenvironment structure to make better future navigation decisions. Our OA\ntechnique uses recurrent neural networks with temporal attention and provides\nbetter results compared to prior works in terms of distance covered during\nnavigation without collisions. In addition, our technique has a high inference\nrate (a key factor in robotic applications) and is energy-efficient as it\nminimizes oscillatory motion of UAV and reduces power wastage.","url_abs":"http://arxiv.org/abs/1811.03307v1","url_pdf":"http://arxiv.org/pdf/1811.03307v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"memory-based-deep-reinforcement-learning-for","repo_url":"https://github.com/abhiksingla/UAV_obstacle_avoidance_controller","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"tf","reach":null},{"paper_slug":"memory-based-deep-reinforcement-learning-for","repo_url":"https://github.com/hbzhang/AwesomeSelfDriving","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok"}}],"tasks":[{"task_slug":"decision-making","task_name":"Decision Making"},{"task_slug":"deep-reinforcement-learning","task_name":"Deep Reinforcement Learning"},{"task_slug":"reinforcement-learning","task_name":"Reinforcement Learning"},{"task_slug":"reinforcement-learning-1","task_name":"Reinforcement Learning (RL)"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}