Papers › Transformer-Based Named Entity Recognition for Automated Server Provisioning

Transformer-Based Named Entity Recognition for Automated Server Provisioning

1 Apr 2025Conference 2025 4archive 2025-07-28

Hossein Damavandi, Hasan Jalali, Boshra Pishgoo

This paper introduces a novel method for automated server provisioning by integrating Transformerbased Named Entity Recognition models with Automated Speech Detection using OpenAI's Whisper. Leveraging advanced Transformer architectures-BERT, RoBERTa, and DeBERTa-combined with robust speech-to-text capabilities, our approach enables IT professionals to provision cloud servers efficiently via natural spoken commands. A customannotated dataset containing real-world and AI-generated provisioning requests is presented, meticulously labeled using the BIO tagging scheme across fourteen critical entity categories relevant to cloud infrastructure provisioning. Comprehensive evaluations of model performance and robustness were conducted under realistic conditions, including controlled transcription noise to simulate practical speech recognition errors. While all tested models achieved high performance on clean test data, results from noisy test scenarios revealed notable disparities in model generalization capabilities. Specifically, DeBERTa exhibited exceptional resilience, maintaining an F1 score of 96.23 % under adverse conditions. These findings highlight the practicality and robustness of combining speech-to-text processing with advanced Named Entity Recognition models, significantly advancing real-time, voice-driven IT automation workflows.

Paper PDF Code

Code

hosseindamavandi/Transformer-NER-for-Automated-Infrastructure report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

NER Named Entity Recognition Named Entity Recognition (NER)Speech Recognition Speech-to-Text named-entity-recognition speech-recognition

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

Adam Attention Attention Dropout BERT DeBERTa Dense Connections Dropout Label Smoothing Layer Normalization Linear Layer Linear Warmup With Linear Decay Multi-Head Attention Residual Connection RoBERTa Softmax Transformer Weight Decay WordPiece

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections