All videos
All videos
Orchestration of ML workloads via Cloud Composer & GKE Kueue
October 24, 2024
Our presentation demonstrates efficient ML workload orchestration using Cloud Composer (managed Airflow) and GKE Kueue. After brief introductions to GKE Kueue and Cloud Composer, it dives into a practical example: LoRA FineTuning of Gemma models. This ML workflow, implemented as an Airflow DAG, includes benchmarking and uploading results to VertexAI. A step-by-step guide and recorded demo complete the presentation, offering a comprehensive understanding of the process.
About the speakers
Piotr Leśniak
Sr Staff Software Engineer at Google
Staff Software Engineer, ex-Akamai, ex-Qualtrics currently working in Google, experienced in distributed and microservice architecture. Focusing on scalability, operational excellence and high quality of delivered…
Read more
Michał Wysokiński
Software Engineering Manager at Google
Michal Wysokinski is a Software Engineer and Engineering Leader currently leading the development of Kueue at Google, where his mission is to make Kubernetes the…
Read more
Other videos that you might like
Thinking Stateful Serverless – Bringing the Power of Akka to Serverless
Leon Stigter
Lessons learnt from going reactive with Reactor
Gautier Di Folco
Consuming headless in the omnichannel networks
Mateusz Strąg
From dreams to reality – what it’s like to find a job that becomes your passion
Iwona Celińska