{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/automating-data-science-pipelines-with-tensor","title":"Automating Data Science Pipelines with Tensor Completion","arxiv_id":"2410.06408","date":"2024-10-08","proceeding":null,"authors":["Shaan Pakala","Bryce Graw","Dawon Ahn","Tam Dinh","Mehnaz Tabassum Mahin","Vassilis Tsotras","Jia Chen","Evangelos E. Papalexakis"],"abstract":"Hyperparameter optimization is an essential component in many data science pipelines and typically entails exhaustive time and resource-consuming computations in order to explore the combinatorial search space. Similar to this problem, other key operations in data science pipelines exhibit the exact same properties. Important examples are: neural architecture search, where the goal is to identify the best design choices for a neural network, and query cardinality estimation, where given different predicate values for a SQL query the goal is to estimate the size of the output. In this paper, we abstract away those essential components of data science pipelines and we model them as instances of tensor completion, where each variable of the search space corresponds to one mode of the tensor, and the goal is to identify all missing entries of the tensor, corresponding to all combinations of variable values, starting from a very small sample of observed entries. In order to do so, we first conduct a thorough experimental evaluation of existing state-of-the-art tensor completion techniques and introduce domain-inspired adaptations (such as smoothness across the discretized variable space) and an ensemble technique which is able to achieve state-of-the-art performance. We extensively evaluate existing and proposed methods in a number of datasets generated corresponding to (a) hyperparameter optimization for non-neural network models, (b) neural architecture search, and (c) variants of query cardinality estimation, demonstrating the effectiveness of tensor completion as a tool for automating data science pipelines. Furthermore, we release our generated datasets and code in order to provide benchmarks for future work on this topic.","url_abs":"https://arxiv.org/abs/2410.06408v1","url_pdf":"https://arxiv.org/pdf/2410.06408v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"automating-data-science-pipelines-with-tensor","repo_url":"https://github.com/shaanpakala/stc_automl","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"hyperparameter-optimization","task_name":"Hyperparameter Optimization"},{"task_slug":"architecture-search","task_name":"Neural Architecture Search"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2410.06408","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2410.06408"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/shaanpakala/stc_automl","reach":{"status":"ok"}}],"summary":{"ran":1,"unverified":15},"by_repo_kind":{"official":{"samples":16,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":16,"samples":[{"code_sha256_prefix":"ba5a102108c49c53","entry":"get_subset","repo":"shaanpakala/stc_automl","repo_kind":"official","path":"src/utilities/helper_functions.py","file_url":"https://github.com/shaanpakala/stc_automl/blob/HEAD/src/utilities/helper_functions.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ba5a102108c49c53"}},{"code_sha256_prefix":"a79f768def8024b6","entry":"NNfit","repo":"shaanpakala/stc_automl","repo_kind":"official","path":"src/utilities/CNN_grid_search.py","file_url":"https://github.com/shaanpakala/stc_automl/blob/HEAD/src/utilities/CNN_grid_search.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a79f768def8024b6"}},{"code_sha256_prefix":"e37c31785111b584","entry":"NNfit","repo":"shaanpakala/stc_automl","repo_kind":"official","path":"src/utilities/MLP_grid_search.py","file_url":"https://github.com/shaanpakala/stc_automl/blob/HEAD/src/utilities/MLP_grid_search.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e37c31785111b584"}},{"code_sha256_prefix":"133e01242bee1ac3","entry":"eval_","repo":"shaanpakala/stc_automl","repo_kind":"official","path":"src/tensor_completion_models/NeAT/metrics.py","file_url":"https://github.com/shaanpakala/stc_automl/blob/HEAD/src/tensor_completion_models/NeAT/metrics.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"133e01242bee1ac3"}},{"code_sha256_prefix":"7c75a24316b77904","entry":"gen_random","repo":"shaanpakala/stc_automl","repo_kind":"official","path":"src/tensor_completion_models/CPD_smooth.py","file_url":"https://github.com/shaanpakala/stc_automl/blob/HEAD/src/tensor_completion_models/CPD_smooth.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7c75a24316b77904"}},{"code_sha256_prefix":"3ee7e8302a4bdf41","entry":"nre","repo":"shaanpakala/stc_automl","repo_kind":"official","path":"src/tensor_completion_models/NeAT/metrics.py","file_url":"https://github.com/shaanpakala/stc_automl/blob/HEAD/src/tensor_completion_models/NeAT/metrics.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3ee7e8302a4bdf41"}},{"code_sha256_prefix":"3b74515b58b4fd6c","entry":"return_best_k_params","repo":"shaanpakala/stc_automl","repo_kind":"official","path":"src/utilities/CNN_grid_search.py","file_url":"https://github.com/shaanpakala/stc_automl/blob/HEAD/src/utilities/CNN_grid_search.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3b74515b58b4fd6c"}},{"code_sha256_prefix":"04017b7cd0f6b4f9","entry":"return_best_k_params","repo":"shaanpakala/stc_automl","repo_kind":"official","path":"src/utilities/MLP_grid_search.py","file_url":"https://github.com/shaanpakala/stc_automl/blob/HEAD/src/utilities/MLP_grid_search.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"04017b7cd0f6b4f9"}},{"code_sha256_prefix":"659258a818186c8c","entry":"return_best_k_params","repo":"shaanpakala/stc_automl","repo_kind":"official","path":"src/utilities/sklearn_grid_search.py","file_url":"https://github.com/shaanpakala/stc_automl/blob/HEAD/src/utilities/sklearn_grid_search.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"659258a818186c8c"}},{"code_sha256_prefix":"f5b7ef0dd06c1af0","entry":"return_best_k_params","repo":"shaanpakala/stc_automl","repo_kind":"official","path":"src/utilities/tensor_completion_grid_search.py","file_url":"https://github.com/shaanpakala/stc_automl/blob/HEAD/src/utilities/tensor_completion_grid_search.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f5b7ef0dd06c1af0"}},{"code_sha256_prefix":"fc73b144df3d8204","entry":"return_nn_eval","repo":"shaanpakala/stc_automl","repo_kind":"official","path":"src/utilities/CNN_grid_search.py","file_url":"https://github.com/shaanpakala/stc_automl/blob/HEAD/src/utilities/CNN_grid_search.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fc73b144df3d8204"}},{"code_sha256_prefix":"56f030989c7e62c3","entry":"return_nn_eval","repo":"shaanpakala/stc_automl","repo_kind":"official","path":"src/utilities/MLP_grid_search.py","file_url":"https://github.com/shaanpakala/stc_automl/blob/HEAD/src/utilities/MLP_grid_search.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"56f030989c7e62c3"}},{"code_sha256_prefix":"a9a09c6e784562d8","entry":"return_tc_eval","repo":"shaanpakala/stc_automl","repo_kind":"official","path":"src/utilities/tensor_completion_grid_search.py","file_url":"https://github.com/shaanpakala/stc_automl/blob/HEAD/src/utilities/tensor_completion_grid_search.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a9a09c6e784562d8"}},{"code_sha256_prefix":"d98fdc38474b51ac","entry":"rmse","repo":"shaanpakala/stc_automl","repo_kind":"official","path":"src/tensor_completion_models/NeAT/metrics.py","file_url":"https://github.com/shaanpakala/stc_automl/blob/HEAD/src/tensor_completion_models/NeAT/metrics.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d98fdc38474b51ac"}},{"code_sha256_prefix":"c9775689aa378119","entry":"train_learned_ensemble","repo":"shaanpakala/stc_automl","repo_kind":"official","path":"src/tensor_completion_models/ETC.py","file_url":"https://github.com/shaanpakala/stc_automl/blob/HEAD/src/tensor_completion_models/ETC.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c9775689aa378119"}},{"code_sha256_prefix":"07eb2f72304c585f","entry":"train_tensor_completion","repo":"shaanpakala/stc_automl","repo_kind":"official","path":"src/utilities/helper_functions.py","file_url":"https://github.com/shaanpakala/stc_automl/blob/HEAD/src/utilities/helper_functions.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"07eb2f72304c585f"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}