Introduction to Zeppelin Notebooks and PySpark 2 0
summary
Zeppelin is shown running with an integrated PySpark 2.0 interpreter and a reproducible repo that builds in ~2 hours via Vagrant/VirtualBox. Live demo passes objects between Spark and Python so notebooks pass data BETWEEN contexts, offers built‑in charts, dynamic forms and one‑click version control, and exports visualizations via WebSocket for embedding in an iframe. Notes state Spark 2.0 is 2–10× faster, adds native CSV and MLlib model persistence; a few visualizations fail on older Zeppelin 0.6.x.
AI-written summary · about
chapters (9)
- 0:00Zeppelin & PySpark intro
- 1:05Zeppelin as all-in-one tool
- 3:17Zeppelin vs Jupyter
- 7:34Spark 2.0 new features
- 9:21Live Zeppelin demo
- 12:14Dynamic forms & visuals
- 15:58Chart types & data exploration
- 17:18Collaboration & sharing
- 18:09Q&A
related talks
41mApache Zeppelin, the missing GUI for your Big Data backend
44mApache Zeppelin: A friendlier way to Flink
37mPixieDust make Jupyter Notebooks with Apache Spark Faster, Flexible, and Easier to use
38mPySpark in Practice
59mSpark 2.0
51mSpotlight on Emerging Data Science Worskspaces and Spark as Development Levers
24mAn Introduction to PySpark
01h 05mData Visualization with Scala tools