~/talk

Building a data science pipeline for the FT with RStudio Connect

on YouTube 17m
Talkat rstudio::conf 2019 · 2019-01-15..01-18· [data-engineering, data-science]

speaker

name:George Kastrinakis
links:none on file

resources

video:https://youtu.be/3sKTdh-xciY
slides:none on file

summary

Describes moving a custom Luigi + Docker + Redshift pipeline into RStudio Connect on Google Cloud so all jobs run from R with BigQuery and GCS storage. Claims complexity falls: three languages and day‑long deployments become all code in R and publish and schedule in minutes; team grows from 2 to 6 and adopts two‑week sprints. Replaces Jenkins, adds Shiny dashboards and alerts; still lacks event‑triggered runs (scheduling is time‑based). replaced Jenkins and monitoring

AI-written summary · about

chapters (7)

  1. 0:00Introduction
  2. 1:00The Financial Times
  3. 7:11The old pipeline
  4. 11:03RStudio Connect
  5. 12:17Sprint Cycle
  6. 13:06Overview
  7. 13:53Questions

related talks

~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.