Charm++ on Kubernetes Cloud
Lightningat Cloud Native + Kubernetes AI Day NA 2024 · on Tuesday, 2024-11-12· at 12:30· Salt Palace | Level 1 | Grand Ballroom A·
summary
Charm++ runtime runs on Kubernetes by reusing the MPI operator with minimal code changes and adding an MPI operator CRD changes that introduce min/max replicas and a job priority field. A controller implements elastic scheduling that shrinks lower‑priority jobs to free CPUs and later expands them. Runtime resizing is demonstrated with a 2D stencil benchmark; rescaling overhead falls below 10% for larger problem sizes. Also supports Charm4py on Kubernetes.
AI-written summary · about
related talks
36mCapacity Scheduling for Elastic Resource Sharing in Kubernetes
33mFrom spreadsheet scheduling to Kubernetes: building an on-premise ML platform
29mScale Your Batch / Big Data / AI Workloads Beyond the K8s...
30mBeyond Experimental: Spark on Kubernetes
23mPractice of Fine-grained Cgroups Resources Scheduling in Kubernetes
19mKeynote: Building Bridges: Cloud Native and High Performance Computing
38mChallenges of and Solutions for Migrating Spark From Legacy Hadoop Clusters To Kubernetes
32mUnraveling the Chaos: Raising Workload Resilience on K8s with Chaos Mesh
