AArch64 and Apache Bigtop: empowering big data everywhere
summary
Concrete progress enabling ARM servers: AArch64 support in Apache Bigtop is upstreamed and officially added (picked-up server support in v1.3.0), with the release resolving over 100 issues and multi-architecture builds. The project produces RPM/DEB packages, supports patch-on-the-fly for native library mismatches, and publishes container images so a full build→deploy→test cycle runs via a Gradle wrapper inside the image. Use Bigtop Provisioner and Sandbox to provision clusters in ~1–2 minutes and run the new integration testing framework 2.0 for CI coverage.
AI-written summary · about
chapters (12)
- 0:00Introduction to AArch64 and Bigtop
- 1:12What is Apache Bigtop
- 3:01Bigtop toolchain and modules
- 7:52Deployment and testing tools
- 10:26Bigtop sandbox demo
- 11:51Integration test framework 2.0
- 14:27Bigtop 1.4 release highlights
- 15:37ARM contributions to Bigtop
- 21:08Lessons learned from ARM enablement
- 22:54Future of Big Data and Bigtop
- 25:28Live demo of Bigtop deployment
- 28:45Q&A session
related talks
25mThe status of Tensorflow on Arm-based HPC
52mScaling AI for the Enterprise
09mBuilding Resilient AI Platforms at Scale
44mEnabling Mars Exploration with AHTSE
05mBuild AI Anywhere with ROCm™ Software: AMD and PyTorch Bring...
52mMaking Pi ServerReady: time for cheap Arm infrastructure be standards-compliant
24mBetween Public Benchmarks and Business Needs
33mOptimizing Java on the EU processor platform