Pintye, István and Kovács, József and Lovas, Róbert (2024) Enhancing Machine Learning-Based Autoscaling for Cloud Resource Orchestration. JOURNAL OF GRID COMPUTING, 22 (4). ISSN 1570-7873 10.1007/s10723-024-09783-1

Text Pintye_1_35471204_ny.pdf Download (2MB)

Abstract

Performance and cost-effectiveness are sustained by efficient management of resources in cloud computing. Current autoscaling approaches, when trying to balance between the consumption of resources and QoS requirements, usually fall short and end up being inefficient and leading to service disruptions. The existing literature has primarily focuses on static metrics and/or proactive scaling approaches which do not align with dynamically changing tasks, jobs or service calls. The key concept of our approach is the use of statistical analysis to select the most relevant metrics for the specific application being scaled. We demonstrated that different applications require different metrics to accurately estimate the necessary resources, highlighting that what is critical for an application may not be for the other. The proper metrics selection for control mechanism which regulates the requried recources of application are described in this study. Introduced selection mechanism enables us to improve previously designed autoscaler by allowing them to react more quickly to sudden load changes, use fewer resources, and maintain more stable service QoS due to the more accurate machine learning models. We compared our method with previous approaches through a carefully designed series of experiments, and the results showed that this approach brings significant improvements, such as reducing QoS violations by up to 80% and reducing VM usage by 3% to 50%. Testing and measurements were conducted on the Hungarian Research Network (HUN-REN) Cloud, which supports the operation of over 300 scientific projects.

Item Type:	Article
Subjects:	Q Science > QA Mathematics and Computer Science > QA75 Electronic computers. Computer science / számítástechnika, számítógéptudomány
Divisions:	Laboratory of Parallel and Distributed Systems
SWORD Depositor:	MTMT Injector
Depositing User:	MTMT Injector
Date Deposited:	07 Nov 2024 07:48
Last Modified:	12 Nov 2024 11:00
URI:	https://eprints.sztaki.hu/id/eprint/10813

Update Item