~/talk

Breaking the data pipeline bottleneck with zero-ETL

Talkat AWS re:Invent 2023 · 2023-11-27..12-01· [data-engineering, databases]
name:Rob Koch
github:robcube
slides:none on file

Live demo wires a MySQL Aurora instance into Amazon Redshift Serverless using IAM roles and binlog replication, showing inserts, updates and deletes appear in seconds (near real‑time) and that Redshift tables are read‑only for synced rows. Setup steps and gotchas include enabling binlog, creating integration IDs, and watching dash/underscore name quirks. Claims: removes custom ETL code and offloads transforms to analytics (ELT), but is a black box today with limited filtering and no per‑load customization. Amazon Aurora and Amazon Redshift Serverless integration works end to end.

AI-written summary · about

  1. 0:00Introduction to zero ETL
  2. 3:42Zero ETL integration demo
  3. 11:17Benefits of zero ETL
  4. 14:01Drawbacks and considerations
  5. 16:40Resources and conclusion
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.