{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2604-04914","title":"Analyzing Symbolic Properties for DRL Agents in Systems and Networking","arxiv_id":"2604.04914","date":"2026-04-06","proceeding":null,"authors":["Mohammad Zangooei","Jannis Weil","Amr Rizk","Mina Tahmasbi Arashloo","Raouf Boutaba"],"abstract":"Deep reinforcement learning (DRL) has shown remarkable performance on complex control problems in systems and networking, including adaptive video streaming, wireless resource management, and congestion control. For safe deployment, however, it is critical to reason about how agents behave across the range of system states they encounter in practice. Existing verification-based methods in this domain primarily focus on point properties, defined around fixed input states, which offer limited coverage and require substantial manual effort to identify relevant input-output pairs for analysis. In this paper, we study symbolic properties, that specify expected behavior over ranges of input states, for DRL agents in systems and networking. We present a generic formulation for symbolic properties, with monotonicity and robustness as concrete examples, and show how they can be analyzed using existing DNN verification engines. Our approach encodes symbolic properties as comparisons between related executions of the same policy and decomposes them into practically tractable sub-properties. These techniques serve as practical enablers for applying existing verification tools to symbolic analysis. Using our framework, diffRL, we conduct an extensive empirical study across three DRL-based control systems, adaptive video streaming, wireless resource management, and congestion control. Through these case studies, we analyze symbolic properties over broad input ranges, examine how property satisfaction evolves during training, study the impact of model size on verifiability, and compare multiple verification backends. Our results show that symbolic properties provide substantially broader coverage than point properties and can uncover non-obvious, operationally meaningful counterexamples, while also revealing practical solver trade-offs and limitations.","url_abs":"https://arxiv.org/abs/2604.04914","url_pdf":"https://arxiv.org/pdf/2604.04914","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2604.04914","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2604.04914"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/mhmd97z/diffRL","reach":null}],"summary":{"unverified":7},"by_repo_kind":{"found_in_text":{"samples":7,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":7,"samples":[{"code_sha256_prefix":"0b5f1444d519e148","entry":"calc_gae","repo":"mhmd97z/diffRL","repo_kind":"found_in_text","path":"applications/aurora/aurora_lib/meta_ppo.py","file_url":"https://github.com/mhmd97z/diffRL/blob/HEAD/applications/aurora/aurora_lib/meta_ppo.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0b5f1444d519e148"}},{"code_sha256_prefix":"8ad93e0d9425b1cb","entry":"get_max_obs_vector","repo":"mhmd97z/diffRL","repo_kind":"found_in_text","path":"applications/aurora/aurora_lib/sender_obs.py","file_url":"https://github.com/mhmd97z/diffRL/blob/HEAD/applications/aurora/aurora_lib/sender_obs.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8ad93e0d9425b1cb"}},{"code_sha256_prefix":"e441629ee11e60a2","entry":"get_min_obs_vector","repo":"mhmd97z/diffRL","repo_kind":"found_in_text","path":"applications/aurora/aurora_lib/sender_obs.py","file_url":"https://github.com/mhmd97z/diffRL/blob/HEAD/applications/aurora/aurora_lib/sender_obs.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e441629ee11e60a2"}},{"code_sha256_prefix":"6f4b089fb3c56307","entry":"get_padded_trajectories","repo":"mhmd97z/diffRL","repo_kind":"found_in_text","path":"applications/aurora/aurora_lib/meta_ppo.py","file_url":"https://github.com/mhmd97z/diffRL/blob/HEAD/applications/aurora/aurora_lib/meta_ppo.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6f4b089fb3c56307"}},{"code_sha256_prefix":"cb432258860643d0","entry":"pcc_aurora_reward","repo":"mhmd97z/diffRL","repo_kind":"found_in_text","path":"applications/aurora/aurora_lib/utils.py","file_url":"https://github.com/mhmd97z/diffRL/blob/HEAD/applications/aurora/aurora_lib/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"cb432258860643d0"}},{"code_sha256_prefix":"cfcfa08c689dbece","entry":"read_json_file","repo":"mhmd97z/diffRL","repo_kind":"found_in_text","path":"applications/aurora/aurora_lib/utils.py","file_url":"https://github.com/mhmd97z/diffRL/blob/HEAD/applications/aurora/aurora_lib/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"cfcfa08c689dbece"}},{"code_sha256_prefix":"52df3044cc9d2768","entry":"zero_one_normalize","repo":"mhmd97z/diffRL","repo_kind":"found_in_text","path":"applications/aurora/aurora_lib/utils.py","file_url":"https://github.com/mhmd97z/diffRL/blob/HEAD/applications/aurora/aurora_lib/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"52df3044cc9d2768"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":{"kind":"leaderboard_placements","source":"Syntology's leaderboard-shaped extractor over the paper's own arXiv-HTML tables: a model pointed at a cell, the number was read from that cell and checked against the board's metric, dataset, split and scale, and an independent check accepted the entry; not reviewed by the paper's authors or the archive's editors","extractor_model":"global.anthropic.claude-sonnet-4-5-20250929-v1:0","verifier_model":null,"prompt_sha":"fa63d4bb9d755694","coverage":{"sentence":"Syntology has checked 6,795 of the 9,581 papers on this site that are newer than the archive; results from the others appear after they are checked.","papers_newer_than_archive":9581,"papers_checked":6795},"entries":[],"not_placed":{"boards":0,"rejected_by_independent_check":0,"refused_by_a_rule":0,"check_did_not_answer":0,"proposed_without_a_cell":0,"declined_by_site":0}}}