A decentralized data platform to take back the control of your data
summary
Barrel is a decentralized data platform built in Erlang that separates control plane from data nodes so local data stores hold encrypted blobs and metadata while monitor nodes run queries and optional Raft replication. It ships with RocksDB bindings, hackney HTTP, erlang_nat and certifi, supports P2P over HTTP, WASM functions, AMQP MQTT Websockets and SSE, and is already used in production. Core code and libraries are being open sourced and development is funded by sponsor subscriptions and paid support so the project stays maintained.
AI-written summary · about
chapters (12)
- 0:00Barrel intro and open source
- 1:49Why I created Barrel
- 3:56Control plane vs storage
- 7:28Multi-model storage and queries
- 10:02Extending Barrel with monitors
- 13:11Why Erlang not Rust/Zig
- 16:02Erlang resilience for databases
- 18:10Erlang OTP concurrency
- 20:16Storage with RocksDB and DO+IFS
- 22:45Sustainable open source
- 25:15On-premise hosting model
- 28:48Q&A
related talks
31mBuilding a Web3 Where Platform Controls our Data
25m🛠 Making Data Useful with Decentralised Compute
26mBeyond Dapps and Code?
22mSolving Everyday Data Problems with FoundationDB
26mPerpetual Storage and building token gated applications
36mKnee Deep Into P2P
32mGetting distributed with Firenest
43mBuild Your Own Distributed System Using Go