Event Processing on the Edge at Scale Using Kubernetes Native Technologies

" summary

Numaflow is a Kubernetes-native, open-source event processing platform that autoscaling from zero to N and runs on K3s or EKS, using CRDs named monvertex and pipeline to compose map/reduce UDFs with fixed/sliding/session windows. It ships SDKs for Java, Python, Go and Rust, communicates via gRPC over Unix domain socket, and demonstrates a monovex deployment of 11 pods sustaining ~4k events/sec on a laptop K3s cluster. Real users run IoT predictive maintenance and radio signal processing (ABCube) even on air-gapped edge devices.

AI-written summary · about

" related talks

• 29mSimplify Stream Data Processing with Declarative, Scalable K8s Native TechnologiesVigith Maurice, Derek Wang · Data on Kubernetes Day NA 2024
• 29mMy First Event-Driven Serverless App with NumaflowGustavo A Bonilla · KCD Guadalajara 2025
• 01h 02mModern Event-Driven Workloads with KnativeRoland Huß · Serverless Architecture Conference 2019
• 34mStream Processing at the Edge with Apache KafkaJakub Scholz · DevConf.CZ 2023
• 25mKubernetes IoT Edge Working Group: Using Event Driven Architecture at EdgeSteven Wong · KubeCon + CloudNativeCon North America 2020 Virtual
• 36mUsing Kubernetes in IOT Edge Node DevelopmentKatherine Lim · Container Camp AU 2019
• 36mKubernetes On the Edge With K3s For a Smart Metering Use CaseHarry Lee · KubeCon + CloudNativeCon North America 2022
• 42mProcessing Millions of Events per Second with Apache Kafka on KubernetesRasmus Selsmark · DevOps Pro Europe 2026