Sparrow, Pirates of the Apache Arrow
summary
A lightweight C++20 implementation of the Apache Arrow memory spec claims practical compatibility with the Arrow C data interface, zero dependencies (except when building with libc++), and C++20 ranges and formatters for idiomatic APIs. Live demos show array construction, mutability for primitive layouts, JupyterLab and in-browser compilation, and extraction of Arrow schema/array pointers. It passes Apache Arrow integration tests and is packaged for conda/Fedora/vcpkg; Sparrow IPC is in progress and nested-layout mutability and aligned allocators remain work in progress.
AI-written summary · about
chapters (9)
- 0:00Introduction
- 1:28Why Sparrow was developed
- 3:17Key features and design
- 3:38Demo: Arrays creation and manipulation
- 10:57Demo: C++ in browser and interop
- 13:04Architecture overview
- 17:41Future plans and roadmap
- 18:46Contributors and resources
- 19:13Q&A
related talks
01h 02mApache Arrow: High-Performance Columnar Data Framework
32mVectorized Query Processing for CPUs using Apache Arrow
47mThe Fletcher Framework: Bringing Apache Arrow to FPGA
06mInterview
16mAirport for DuckDB: Letting DuckDB take Apache Arrow Flights
45mAccelerating OpenSearch With Streaming: Apache Arrow, Flight, Data...
26mUnlocking Scalable Distributed Training With Arrow Data Cache on Kubernetes
33mExtending Pandas using Apache Arrow and Numba