Private Distributed Resource Management Data: Predicting CPU Utilization with Bi-LSTM and Federated Learning

Artificial intelligence is increasingly pervasive in many sectors. In this regard, IT operations are having a big deal on extracting useful information from the large amount of resources' datasets available (e.g., CPU, memory, disk, energy). The issue is bigger if we consider multiple cloud tiers. Artificial intelligence is a key technology when the main goal is to improve microservice migration through offload management. However, it struggles to facilitate distributed contexts where both data transfer needs to be reduced and data privacy needs to be increased. There is therefore a need for novel solutions that resolve the problem of prediction resource utilization (e.g. CPU) while maintaining data privacy and reducing data communication. In this paper, we present a Bi-LSTM model with attention trained in Federated Learning on CPU historical data. The dataset comes from multiple Microsoft Azure trace. The results are compared with the literature and showcase a good generalization and prediction results for metrics collected by multiple virtual machines. The model is evaluated in terms of R-squared, MSE, RMSE and MAE.