Dirty NoSQL

on YouTube ↗27m

" summary

A tiny Node.js key value store called Dirty uses an embedded append-only newline-JSON file with no networking or indexes and batches writes from an in-memory queue to disk. Implementation is 150 lines of code and aims for under 1,000,000 records. Benchmarks show about 200,000 JSON records/sec for numeric keys when flushing, 70,000/sec for 256 byte strings, get rates claimed near 50 million ops/sec in memory and set around 5 million before disk waits.

AI-written summary · about

" chapters (15)

1. 0:00Intro
2. 0:18About
3. 3:57150 lines of code
4. 4:45Append-only JSON log
5. 5:57No Networking
6. 7:48Benchmarks
7. 8:35dirty.set()
8. 12:42dirty.forEach()
9. 13:49The Wall
10. 15:46The Internet
11. 16:36Flexible guarantees
12. 18:54Memory / Disk Hybrids
13. 19:58Replication
14. 21:25Web Services
15. 22:14Questions?

" related talks

• 52mHow to Build a DatabaseLiam McLennan · CPH DevFest 2024
• 39mGit the NoSQL DatabaseBrandon Keepers · Aloha RubyConf 2012
• 15mSaved by In-Memory NoSQLDeepak K Gupta · PyCon US 2020
• 35mNoSQL, No Server, No problem: Using ORM's in Javascript ApplicationsJason Maggard · RVA JavaScript Conf 2019
• 21mUse cases that drive the need for NoSQL databasesJeff Morris · Big Data & AI Toronto 2020
• 01h 02mRonDB: A Key-Value Store with SQL Capabilities and LATS PropertiesMikael Ronström · Vaccination Database Tech Talks (Booster) - Spring 2022
• 45mNoSQL: Death to Relational DatabasesBen Scofield · RubyConf 2009
• 34mData Storage: NoSQL Toasters and a Cloud of Kitchen SinksCasey Rosenthal · RailsConf 2013