Generative AI on Kubernetes: Operationalizing large language models