Introducing Quine: a Streaming Graph for Modern Data Pipelines
summary
Quine is a streaming graph interpreter that consumes Kafka/Kinesis events, builds a versioned graph per entity and stores per-node histories with append-only event sourcing, so joins don't require time windows and historical queries return past graph state. Queries compile into actor-based computation, and standing queries live inside the graph and push matches immediately downstream. Deployments back storage with Cassandra or RocksDB, reach over a million events per second in benchmarks, and the project is open source at quine.io.
AI-written summary · about
chapters (9)
- 0:00Introduction
- 1:23What is Quine
- 2:20The Streaming Graph Problem
- 5:51Introducing Quine
- 7:57Why a graph
- 11:02How Quine works
- 14:15Event sourcing
- 17:40New capabilities
- 20:59Where does Quine fit
related talks
32mStreaming Graph Search with Quine.
21mStreaming DataFrames: A New Way to Process Streaming Data
43mSimplifying Real-Time ML Pipelines with Quix Streams: An Open Source Python Library for ML Engineers
01h 11mChange data capture pipelines with Debezium and Kafka Streams
47mOne Does Not Simply Query a Stream
33mQUARK: A PURELY-FUNCTIONAL SCALA DSL FOR DATA PROCESSING & ANALYTICS
29mSimplify Stream Data Processing with Declarative, Scalable K8s Native Technologies
42mdistributed stream processing for everyone with KSQL #bbuzz