Building Data Breach Search Engines with MariaDB
summary
Runs breachdirectory.com as a real data breach search engine built on MariaDB and InnoDB, handling billions of rows by looping queries across per-table files and using bulk LOAD DATA INFILE with autocommit off and a final COMMIT. Recommends relational over NoSQL for ACID guarantees, sets InnoDB buffer pool 16GB and IB datafile autoextend (example max 100GB), relies on EXPLAIN + covering index to avoid disk scans, and uses MD5 tokens and request filtering to block CSRF and SQL injection.
AI-written summary · about
chapters (12)
- 0:00Introduction
- 3:41Data breaches and search engines
- 7:16SQL vs NoSQL
- 11:57MariaDB storage engines
- 26:56Optimizing for big data
- 31:52Database performance
- 42:53Indexing strategies
- 50:10Book promotion
- 52:43Live demo setup
- 1:01:04Security measures
- 1:15:58Query analysis
- 1:20:15Q&A
related talks
25mBillions of Records in MySQL: Lessons Learned
18mBuilding Data Lake with MariaDB ColumnStore
17mState of MariaDB
41mMariaDB The New MySQL
58mIntroducing ScaleDB, the New Clustered, Distributed Storage Engine for MySQL (Part 1)
47mOn the past, present and future of Open Source databases
25mThe future of databases: Combining operational and analytical data at massive scale
38mRunning MySQL & MariaDB Server securely in 2019