{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/flaming-hot-initiation-with-regular-execution","title":"Flaming-hot Initiation with Regular Execution Sampling for Large Language Models","arxiv_id":"2410.21236","date":"2024-10-28","proceeding":null,"authors":["Weizhe Chen","Zhicheng Zhang","Guanlin Liu","Renjie Zheng","Wenlei Shi","Chen Dun","Zheng Wu","Xing Jin","Lin Yan"],"abstract":"Since the release of ChatGPT, large language models (LLMs) have demonstrated remarkable capabilities across various domains. A key challenge in developing these general capabilities is efficiently sourcing diverse, high-quality data. This becomes especially critical in reasoning-related tasks with sandbox checkers, such as math or code, where the goal is to generate correct solutions to specific problems with higher probability. In this work, we introduce Flaming-hot Initiation with Regular Execution (FIRE) sampling, a simple yet highly effective method to efficiently find good responses. Our empirical findings show that FIRE sampling enhances inference-time generation quality and also benefits training in the alignment stage. Furthermore, we explore how FIRE sampling improves performance by promoting diversity and analyze the impact of employing FIRE at different positions within a response.","url_abs":"https://arxiv.org/abs/2410.21236v1","url_pdf":"https://arxiv.org/pdf/2410.21236v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"flaming-hot-initiation-with-regular-execution","repo_url":"https://github.com/agentica-project/verl-pipeline","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"flaming-hot-initiation-with-regular-execution","repo_url":"https://github.com/yaof20/real","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"diversity","task_name":"Diversity"},{"task_slug":"math","task_name":"Math"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2410.21236","atlas_url":"https://app.syntology.ai/?focus=2410.21236","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2410.21236"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/agentica-project/verl-pipeline","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/yaof20/real","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran_draft_wrong":2,"ran_honours":1,"ran":3,"ran_fixture":1,"unverified":4},"by_repo_kind":{"listed":{"samples":11,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"f887d72c9492d9ee","entry":"convert_to_regular_types","repo":"yaof20/real","repo_kind":"listed","path":"verl/trainer/fsdp_sft_trainer.py","file_url":"https://github.com/yaof20/real/blob/HEAD/verl/trainer/fsdp_sft_trainer.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"f887d72c9492d9ee"}},{"code_sha256_prefix":"216e28c040173a61","entry":"extract_step","repo":"yaof20/real","repo_kind":"listed","path":"verl/trainer/fsdp_sft_trainer.py","file_url":"https://github.com/yaof20/real/blob/HEAD/verl/trainer/fsdp_sft_trainer.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"216e28c040173a61"}},{"code_sha256_prefix":"fe79c459a3e4cc64","entry":"get_huggingface_actor_config","repo":"yaof20/real","repo_kind":"listed","path":"verl/utils/model.py","file_url":"https://github.com/yaof20/real/blob/HEAD/verl/utils/model.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"fe79c459a3e4cc64"}},{"code_sha256_prefix":"42a7954a8cfa89e0","entry":"is_transformers_version_in_range","repo":"yaof20/real","repo_kind":"listed","path":"verl/models/transformers/monkey_patch.py","file_url":"https://github.com/yaof20/real/blob/HEAD/verl/models/transformers/monkey_patch.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"42a7954a8cfa89e0"}},{"code_sha256_prefix":"be670aa6ccf31828","entry":"merge_by_placement","repo":"yaof20/real","repo_kind":"listed","path":"experiments/safesql_and_apps/model_formatting/model_merger.py","file_url":"https://github.com/yaof20/real/blob/HEAD/experiments/safesql_and_apps/model_formatting/model_merger.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"be670aa6ccf31828"}},{"code_sha256_prefix":"21331a58f93375e4","entry":"union_tensor_dict","repo":"yaof20/real","repo_kind":"listed","path":"verl/protocol.py","file_url":"https://github.com/yaof20/real/blob/HEAD/verl/protocol.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"DEP_MISSING","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"21331a58f93375e4"}},{"code_sha256_prefix":"25f0ea3f460f6ce1","entry":"unpad_dataproto","repo":"yaof20/real","repo_kind":"listed","path":"verl/protocol.py","file_url":"https://github.com/yaof20/real/blob/HEAD/verl/protocol.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"25f0ea3f460f6ce1"}},{"code_sha256_prefix":"1fb4adb621eefddc","entry":"apply_monkey_patch","repo":"yaof20/real","repo_kind":"listed","path":"verl/models/transformers/monkey_patch.py","file_url":"https://github.com/yaof20/real/blob/HEAD/verl/models/transformers/monkey_patch.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"1fb4adb621eefddc"}},{"code_sha256_prefix":"660713a8fa047736","entry":"get_generation_config","repo":"yaof20/real","repo_kind":"listed","path":"verl/utils/model.py","file_url":"https://github.com/yaof20/real/blob/HEAD/verl/utils/model.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"660713a8fa047736"}},{"code_sha256_prefix":"919cf310ad4c189a","entry":"get_weight_loader","repo":"yaof20/real","repo_kind":"listed","path":"verl/models/weight_loader_registry.py","file_url":"https://github.com/yaof20/real/blob/HEAD/verl/models/weight_loader_registry.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"919cf310ad4c189a"}},{"code_sha256_prefix":"3b15e2ac7497c441","entry":"squeeze","repo":"yaof20/real","repo_kind":"listed","path":"verl/utils/model.py","file_url":"https://github.com/yaof20/real/blob/HEAD/verl/utils/model.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3b15e2ac7497c441"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}