{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/rotation-equivariant-siamese-networks-for","title":"Rotation Equivariant Siamese Networks for Tracking","arxiv_id":"2012.13078","date":"2020-12-24","proceeding":"CVPR 2021 1","authors":["Deepak K. Gupta","Devanshu Arya","Efstratios Gavves"],"abstract":"Rotation is among the long prevailing, yet still unresolved, hard challenges encountered in visual object tracking. The existing deep learning-based tracking algorithms use regular CNNs that are inherently translation equivariant, but not designed to tackle rotations. In this paper, we first demonstrate that in the presence of rotation instances in videos, the performance of existing trackers is severely affected. To circumvent the adverse effect of rotations, we present rotation-equivariant Siamese networks (RE-SiamNets), built through the use of group-equivariant convolutional layers comprising steerable filters. SiamNets allow estimating the change in orientation of the object in an unsupervised manner, thereby facilitating its use in relative 2D pose estimation as well. We further show that this change in orientation can be used to impose an additional motion constraint in Siamese tracking through imposing restriction on the change in orientation between two consecutive frames. For benchmarking, we present Rotation Tracking Benchmark (RTB), a dataset comprising a set of videos with rotation instances. Through experiments on two popular Siamese architectures, we show that RE-SiamNets handle the problem of rotation very well and out-perform their regular counterparts. Further, RE-SiamNets can accurately estimate the relative change in pose of the target in an unsupervised fashion, namely the in-plane rotation the target has sustained with respect to the reference frame.","url_abs":"https://arxiv.org/abs/2012.13078v1","url_pdf":"https://arxiv.org/pdf/2012.13078v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"rotation-equivariant-siamese-networks-for","repo_url":"https://github.com/dkgupta90/re-siamnet","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":{"status":"unanswered"}},{"paper_slug":"rotation-equivariant-siamese-networks-for","repo_url":"https://github.com/debjani-bhowmick/harmonic-net-pytorch","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"2d-pose-estimation","task_name":"2D Pose Estimation"},{"task_slug":"benchmarking","task_name":"Benchmarking"},{"task_slug":"object-tracking","task_name":"Object Tracking"},{"task_slug":"pose-estimation","task_name":"Pose Estimation"},{"task_slug":"visual-object-tracking","task_name":"Visual Object Tracking"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2012.13078","atlas_url":"https://app.syntology.ai/?focus=2012.13078","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2012.13078"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/debjani-bhowmick/harmonic-net-pytorch","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/dkgupta90/re-siamnet","reach":{"status":"unanswered"}}],"summary":{"ran_fixture":1,"unverified":2},"by_repo_kind":{"listed":{"samples":3,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":3,"samples":[{"code_sha256_prefix":"fb9990354d289b60","entry":"avg_pool","repo":"debjani-bhowmick/harmonic-net-pytorch","repo_kind":"listed","path":"hnet_ops.py","file_url":"https://github.com/debjani-bhowmick/harmonic-net-pytorch/blob/HEAD/hnet_ops.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fb9990354d289b60"}},{"code_sha256_prefix":"e5ff4daf759f4ace","entry":"concat_feature_magnitudes","repo":"debjani-bhowmick/harmonic-net-pytorch","repo_kind":"listed","path":"hnet_ops.py","file_url":"https://github.com/debjani-bhowmick/harmonic-net-pytorch/blob/HEAD/hnet_ops.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e5ff4daf759f4ace"}},{"code_sha256_prefix":"1081345f030d00fb","entry":"h_conv","repo":"debjani-bhowmick/harmonic-net-pytorch","repo_kind":"listed","path":"hnet_ops.py","file_url":"https://github.com/debjani-bhowmick/harmonic-net-pytorch/blob/HEAD/hnet_ops.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1081345f030d00fb"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}