Raj Bains, Prophecy | Databricks Data + AI Summit 2023

on YouTube ↗12m

" summary

Prophecy presents a low‑code data engineering platform that generates production Spark/Scala or dbt Core SQL code and keeps data in place on Databricks or Snowflake. It already runs tens of thousands of pipelines for Fortune 5/10 customers and exposes onboarding via app.prophecy.io and Databricks Partner Connect. A newly released data copilot converts English prompts into dbt Core pipelines, and a Pinecone + OpenAI workflow ingests unstructured data into vectors so a chatbot can be built in about a week.

AI-written summary · about

" chapters (8)

1. 0:00Intro
2. 0:47What is Prophecy
3. 3:15The Hadoop movement
4. 4:38New product
5. 5:50ETL use case
6. 7:03Open source
7. 8:13Prophecy App
8. 9:04Data CoPilot

" related talks

• 25mRaj Bains, Prophecy.io | Databricks Data + AI Summit 2024Raj Bains · Databricks Data + AI Summit 2024
• 17mHow will AI transform your data platform?Ben Jarvis, Manoj Matharu · SQLBits 2024
• 52mElevate your data and AI governance with Databricks Data Intelligence PlatformPamela Pettit, Jim Thorstad · AWS re:Invent 2023
• 14mRik Tamm-Daniels, Informatica | Databricks Data + AI Summit 2024Rik Tamm-Daniels · Databricks Data + AI Summit 2024
• 22mSanjeev Mohan, SanjMo & Tony Baer, dbInsight | Databricks Data + AI Summit 2024Sanjeev Mohan, Tony Baer · Databricks Data + AI Summit 2024
• 18mRohit Choudhary, Acceldata | Databricks Data + AI Summit 2024Rohit Choudhary · Databricks Data + AI Summit 2024
• 01mDatabricks CustomersData + AI Summit 2024
• 25mJeff Veis & Anand Raman, Impetus Technologies | Databricks Data + AI Summit 2024Anand Raman, Jeff Veis · Databricks Data + AI Summit 2024