{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/temporal-convolutional-networks-for-action","title":"Temporal Convolutional Networks for Action Segmentation and Detection","arxiv_id":"1611.05267","date":"2016-11-16","proceeding":"CVPR 2017 7","authors":["Colin Lea","Michael D. Flynn","Rene Vidal","Austin Reiter","Gregory D. Hager"],"abstract":"The ability to identify and temporally segment fine-grained human actions\nthroughout a video is crucial for robotics, surveillance, education, and\nbeyond. Typical approaches decouple this problem by first extracting local\nspatiotemporal features from video frames and then feeding them into a temporal\nclassifier that captures high-level temporal patterns. We introduce a new class\nof temporal models, which we call Temporal Convolutional Networks (TCNs), that\nuse a hierarchy of temporal convolutions to perform fine-grained action\nsegmentation or detection. Our Encoder-Decoder TCN uses pooling and upsampling\nto efficiently capture long-range temporal patterns whereas our Dilated TCN\nuses dilated convolutions. We show that TCNs are capable of capturing action\ncompositions, segment durations, and long-range dependencies, and are over a\nmagnitude faster to train than competing LSTM-based Recurrent Neural Networks.\nWe apply these models to three challenging fine-grained datasets and show large\nimprovements over the state of the art.","url_abs":"http://arxiv.org/abs/1611.05267v1","url_pdf":"http://arxiv.org/pdf/1611.05267v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"temporal-convolutional-networks-for-action","repo_url":"https://github.com/BehnooshParsa/HumanActionRecognition_with_ErgonomicRisk","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok"}},{"paper_slug":"temporal-convolutional-networks-for-action","repo_url":"https://github.com/coderSkyChen/Action_Recognition_Zoo","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"temporal-convolutional-networks-for-action","repo_url":"https://github.com/colincsl/TemporalConvolutionalNetworks","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":null},{"paper_slug":"temporal-convolutional-networks-for-action","repo_url":"https://github.com/sadari1/TumorDetectionDeepLearning","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok"}},{"paper_slug":"temporal-convolutional-networks-for-action","repo_url":"https://github.com/yz-cnsdqz/TemporalActionParsing-FineGrained","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"action-segmentation","task_name":"Action Segmentation"},{"task_slug":"decoder","task_name":"Decoder"},{"task_slug":"skeleton-based-action-recognition","task_name":"Skeleton Based Action Recognition"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/action-segmentation-on-gtea-1","task":"Action Segmentation","dataset":"GTEA","model":"ED-TCN","rank_in_archive_order":27,"of":28,"metrics":{"Acc":"64.0","Edit":"-","F1@10%":"72.2","F1@25%":"69.3","F1@50%":"56.0"},"uses_additional_data":false},{"leaderboard":"/sota/skeleton-based-action-recognition-on-varying","task":"Skeleton Based Action Recognition","dataset":"Varying-view RGB-D Action-Skeleton","model":"TCN","rank_in_archive_order":6,"of":7,"metrics":{"Accuracy (AV I)":"43%","Accuracy (AV II)":"64%","Accuracy (CS)":"56%","Accuracy (CV I)":"16%","Accuracy (CV II)":"43%"},"uses_additional_data":false}],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=1611.05267","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1611.05267"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/sadari1/TumorDetectionDeepLearning","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/colincsl/TemporalConvolutionalNetworks","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/yz-cnsdqz/TemporalActionParsing-FineGrained","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/BehnooshParsa/HumanActionRecognition_with_ErgonomicRisk","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/coderSkyChen/Action_Recognition_Zoo","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_draft_wrong":2,"unverified":19},"by_repo_kind":{"listed":{"samples":21,"ran":2,"repositories":3}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"06d279655c9e1de9","entry":"closest_file","repo":"colincsl/TemporalConvolutionalNetworks","repo_kind":"listed","path":"code/datasets.py","file_url":"https://github.com/colincsl/TemporalConvolutionalNetworks/blob/HEAD/code/datasets.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"06d279655c9e1de9"}},{"code_sha256_prefix":"a7f295162b45beb0","entry":"remove_exts","repo":"colincsl/TemporalConvolutionalNetworks","repo_kind":"listed","path":"code/datasets.py","file_url":"https://github.com/colincsl/TemporalConvolutionalNetworks/blob/HEAD/code/datasets.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a7f295162b45beb0"}},{"code_sha256_prefix":"98987430faeae0e4","entry":"WaveNet_activation","repo":"colincsl/TemporalConvolutionalNetworks","repo_kind":"listed","path":"code/tf_models.py","file_url":"https://github.com/colincsl/TemporalConvolutionalNetworks/blob/HEAD/code/tf_models.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"98987430faeae0e4"}},{"code_sha256_prefix":"76c2c6373d14c20d","entry":"WaveNet_activation","repo":"yz-cnsdqz/TemporalActionParsing-FineGrained","repo_kind":"listed","path":"code/tf_models.py","file_url":"https://github.com/yz-cnsdqz/TemporalActionParsing-FineGrained/blob/HEAD/code/tf_models.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"76c2c6373d14c20d"}},{"code_sha256_prefix":"c883039138eb45f8","entry":"acc_per_class","repo":"yz-cnsdqz/TemporalActionParsing-FineGrained","repo_kind":"listed","path":"code/metrics.py","file_url":"https://github.com/yz-cnsdqz/TemporalActionParsing-FineGrained/blob/HEAD/code/metrics.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c883039138eb45f8"}},{"code_sha256_prefix":"8004ab3df5eb8302","entry":"accuracy","repo":"yz-cnsdqz/TemporalActionParsing-FineGrained","repo_kind":"listed","path":"code/metrics.py","file_url":"https://github.com/yz-cnsdqz/TemporalActionParsing-FineGrained/blob/HEAD/code/metrics.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8004ab3df5eb8302"}},{"code_sha256_prefix":"be05a6e3e87f6f10","entry":"build_conv","repo":"coderSkyChen/Action_Recognition_Zoo","repo_kind":"listed","path":"model_zoo/bninception/layer_factory.py","file_url":"https://github.com/coderSkyChen/Action_Recognition_Zoo/blob/HEAD/model_zoo/bninception/layer_factory.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"be05a6e3e87f6f10"}},{"code_sha256_prefix":"f697d40c53839400","entry":"channel_normalization","repo":"yz-cnsdqz/TemporalActionParsing-FineGrained","repo_kind":"listed","path":"code/tf_models.py","file_url":"https://github.com/yz-cnsdqz/TemporalActionParsing-FineGrained/blob/HEAD/code/tf_models.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f697d40c53839400"}},{"code_sha256_prefix":"87878118970340bc","entry":"compact_bilinear_pooling_layer","repo":"yz-cnsdqz/TemporalActionParsing-FineGrained","repo_kind":"listed","path":"code/compact_bilinear_pooling.py","file_url":"https://github.com/yz-cnsdqz/TemporalActionParsing-FineGrained/blob/HEAD/code/compact_bilinear_pooling.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"87878118970340bc"}},{"code_sha256_prefix":"2f0ad6423dba6ceb","entry":"get_basic_layer","repo":"coderSkyChen/Action_Recognition_Zoo","repo_kind":"listed","path":"model_zoo/bninception/layer_factory.py","file_url":"https://github.com/coderSkyChen/Action_Recognition_Zoo/blob/HEAD/model_zoo/bninception/layer_factory.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2f0ad6423dba6ceb"}},{"code_sha256_prefix":"99e441e1779f2584","entry":"inceptionresnetv2","repo":"coderSkyChen/Action_Recognition_Zoo","repo_kind":"listed","path":"model_zoo/inceptionresnetv2/pytorch_load.py","file_url":"https://github.com/coderSkyChen/Action_Recognition_Zoo/blob/HEAD/model_zoo/inceptionresnetv2/pytorch_load.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"99e441e1779f2584"}},{"code_sha256_prefix":"d32fef6df85c8973","entry":"inceptionv4","repo":"coderSkyChen/Action_Recognition_Zoo","repo_kind":"listed","path":"model_zoo/inceptionv4/pytorch_load.py","file_url":"https://github.com/coderSkyChen/Action_Recognition_Zoo/blob/HEAD/model_zoo/inceptionv4/pytorch_load.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d32fef6df85c8973"}},{"code_sha256_prefix":"7f7a53e95b6da888","entry":"macro_accuracy","repo":"yz-cnsdqz/TemporalActionParsing-FineGrained","repo_kind":"listed","path":"code/metrics.py","file_url":"https://github.com/yz-cnsdqz/TemporalActionParsing-FineGrained/blob/HEAD/code/metrics.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7f7a53e95b6da888"}},{"code_sha256_prefix":"4f1d751693519d59","entry":"make_padding","repo":"coderSkyChen/Action_Recognition_Zoo","repo_kind":"listed","path":"model_zoo/inceptionresnetv2/tensorflow_dump.py","file_url":"https://github.com/coderSkyChen/Action_Recognition_Zoo/blob/HEAD/model_zoo/inceptionresnetv2/tensorflow_dump.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4f1d751693519d59"}},{"code_sha256_prefix":"b50ea12bc6767488","entry":"mask_data","repo":"yz-cnsdqz/TemporalActionParsing-FineGrained","repo_kind":"listed","path":"code/utils.py","file_url":"https://github.com/yz-cnsdqz/TemporalActionParsing-FineGrained/blob/HEAD/code/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b50ea12bc6767488"}},{"code_sha256_prefix":"a47eec9325b7d9e1","entry":"match_lengths","repo":"yz-cnsdqz/TemporalActionParsing-FineGrained","repo_kind":"listed","path":"code/utils.py","file_url":"https://github.com/yz-cnsdqz/TemporalActionParsing-FineGrained/blob/HEAD/code/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a47eec9325b7d9e1"}},{"code_sha256_prefix":"8eb9376364bd190f","entry":"max_filter","repo":"yz-cnsdqz/TemporalActionParsing-FineGrained","repo_kind":"listed","path":"code/tf_models.py","file_url":"https://github.com/yz-cnsdqz/TemporalActionParsing-FineGrained/blob/HEAD/code/tf_models.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8eb9376364bd190f"}},{"code_sha256_prefix":"2933e3a59e4c6ae9","entry":"parse_expr","repo":"coderSkyChen/Action_Recognition_Zoo","repo_kind":"listed","path":"model_zoo/bninception/layer_factory.py","file_url":"https://github.com/coderSkyChen/Action_Recognition_Zoo/blob/HEAD/model_zoo/bninception/layer_factory.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2933e3a59e4c6ae9"}},{"code_sha256_prefix":"ae9e3d8a0c2437a3","entry":"test","repo":"coderSkyChen/Action_Recognition_Zoo","repo_kind":"listed","path":"model_zoo/inceptionresnetv2/pytorch_load.py","file_url":"https://github.com/coderSkyChen/Action_Recognition_Zoo/blob/HEAD/model_zoo/inceptionresnetv2/pytorch_load.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ae9e3d8a0c2437a3"}},{"code_sha256_prefix":"0795c8d92282a8a8","entry":"test","repo":"coderSkyChen/Action_Recognition_Zoo","repo_kind":"listed","path":"model_zoo/inceptionv4/pytorch_load.py","file_url":"https://github.com/coderSkyChen/Action_Recognition_Zoo/blob/HEAD/model_zoo/inceptionv4/pytorch_load.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0795c8d92282a8a8"}},{"code_sha256_prefix":"192ada040c3a7091","entry":"unmask","repo":"yz-cnsdqz/TemporalActionParsing-FineGrained","repo_kind":"listed","path":"code/utils.py","file_url":"https://github.com/yz-cnsdqz/TemporalActionParsing-FineGrained/blob/HEAD/code/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"192ada040c3a7091"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}