~/talk

Efficiency up, failed releases down; compliant production data for your test and dev environments

Talkat SQLBits 2023 · 2023-03-14..03-18· [testing, data-engineering]
links:none on file
slides:none on file

Explains how to get realistic, compliant non‑production databases by tagging sensitive fields with Data Catalog, generating rules to detect PII and formats, and applying deterministic and substitution masks with Data Masker so emails, cards and linked rows remain realistic but safe. Creates one anonymized source image and spawns space‑efficient clones (supports very large DBs, demo mentions ~64 TB) to cut per‑developer restore time from many hours to minutes. Notes generated fake data often mismatches production distributions.

AI-written summary · about

  1. 0:00Compliant production data intro
  2. 3:19Why production data is risky
  3. 6:55Realistic test data role
  4. 9:05Identifying and cleaning data challenges
  5. 12:42Data management hurdles
  6. 18:27Tagging data for compliance
  7. 26:12Never use production data directly
  8. 27:14Generated vs masked data
  9. 30:06Large DBs in development
  10. 32:37DB sharing limits
  11. 35:44Risks of unmasked data
  12. 38:40Catalog and masking tools
  13. 40:46Demo: Masking and cloning DBs
  14. 47:14Summary and Q&A
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.