Scala and the JVM as a Big Data Platform
summary
Covers Apache Spark’s Scala-based API and how its similarity to Scala collections attracts developers, then examines JVM limitations for high-performance data processing and Spark’s Tungsten initiative (custom data layouts, manual on-heap and off-heap memory management) as an internal optimization approach to address those weaknesses.
AI-written summary · about
related talks
45mScala and the JVM as a Big Data Platform Lessons from Apache Spark
01h 12mBig Data in Java World: Apache Spark and Scala. Arch and live coding
47mScala: The Unpredicted Lingua Franca for Data Science
47mScala: The Unpredicted Lingua Franca for Data Science
23mThe Future of Scala Performance on Big Data
47mKeeping the “fun” in Apache Spark Datasets and FP
04minterview
40mScala and Spark in the New Deep Learning Era