DBSP: A unified (practical) theory of databases, streams, and incremental computation
summary
DBSP presents a concrete claim: any SQL or Datalog query can be mechanically transformed into a streaming, incremental program by treating tables as streams (snapshots as the integral of transactions) and using simple operators like delay/integrate pair and a discrete derivative. The theory uses Abelian groups and z-sets (integer weights per row) and yields a working system: an open source DBSP runtime in Rust plus a SQL compiler that passes millions of SQL logic tests.
AI-written summary · about
chapters (6)
- 0:00Introduction to DBSP
- 1:08Incremental computation
- 4:15Stream operators
- 8:56Database streaming model
- 12:48Implementation and efficiency
- 16:05Conclusion and Q&A
