Proactive Continuous Operations using Large Language Models (LLMs) and AIOps

Hausi A. Müller, Marin Litoiu, Luis F. Rivera, Mohammadreza Rasolroveicy, Norha M. Villegas, Gabriel Tamura, Ian Watts, Eric Erpenbach, Laura Shwartz

Abstract: Advances and synergies between AI and Cloud computing are driv-ing increased levels of automation and autonomy in the strenuous operation of modern and complex IT systems and environments (IT-Sys|Envs). This notion, often termed as AIOps, is transforming the landscape of IT-Sys|Env operations by a providing a framework to augment DevOps teams’ capabilities to cope with inevitable complexities and uncertainties. Through operational optimization and rapid response and risk mitigation mechanisms, AIOps sup-presses factors that might threaten service-level agreement com-pliance or value delivery. A pivotal aspect of this transformation, and its promising future, lies in the integration of AIOps with other groundbreaking technologies such as Large Language Models (LLMs) and Digital Twins (DTs), especially in the context of Cloud environments. The 1st CASCON Workshop on Proactive Continuous Operations Using LLMs and AIOps provided a dynamic platform for researchers and industry practitioners to exchange insights, advancements, and ideas in AI, Cloud, and automation.