Reducing Communication Overhead in Federated Learning for Network Anomaly Detection with Adaptive Client Selection
- University of Texas at El Paso
- Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)
Communication overhead in federated learning (FL) poses a significant challenge for network anomaly detection systems, where the myriad of client configurations and network conditions can severely impact system efficiency and detection accuracy. While existing approaches attempt to address this through individual optimization techniques, they often fail to maintain the delicate balance between reduced overhead and detection performance. This paper presents an adaptive FL framework that dynamically combines batch size optimization, client selection, and asynchronous updates to achieve efficient anomaly detection. Through extensive profiling and experimental analysis on two distinct datasets-UNSW-NBIS for general network traffic and ROAD for automotive networks-our framework reduces communication overhead by 97.6%; (from 700.0s to 16.8s) compared to synchronous baseline approaches while maintaining comparable detection accuracy (95.10%; vs. 95.12%;). Statistical validation using Mann-Whitney U test confirms significant improvements (p < 0.05) over existing FL approaches across both datasets, demonstrating the framework's adaptability to different network security contexts. Detailed profiling analysis reveals the efficiency gains through dramatic reductions in GPU operations and memory transfers while maintaining robust detection performance under varying client conditions.
- Research Organization:
- National Energy Technology Laboratory
- Sponsoring Organization:
- US DEPARTMENT OF ENERGY
- DOE Contract Number:
- FE0032089
- OSTI ID:
- 2583896
- Country of Publication:
- United States
- Language:
- English
Similar Records
Efficient Client Selection in Federated Learning
Federated Learning for Efficient Condition Monitoring and Anomaly Detection in Industrial Cyber-Physical Systems