Blaze: crunching data in different formats through a single API.
summary
Blaze gives a pandas/numpy-like API that runs the same expression on CSVs, SQL or NoSQL back ends; Odo moves data between formats (JSON, SQL, CSV, Python structures) and can copy from S3 or SSH; DataShape declares column types so dates and decimals survive conversion. Continuum IO funds core work (a $3 million grant in 2013). Blaze chunks files to compute totals across many CSVs without blowing RAM and can swap to a faster database backend transparently though it is not a universal performance fix.
AI-written summary · about
chapters (4)
related talks
36mScale your data, not your process: Welcome to the Blaze ecosystem
32mLightning Talks
30mBlazing fast I/O of data in the cloud with Daft Dataframes
25mNew Trends In Storing Large Data Silos With Python
31mThe PyData map: Presenting a map of the landscape of PyData tools
41mApache Zeppelin, the missing GUI for your Big Data backend
44mUsing Python with Hadoop to create production ready big data applications
59mSpark 2.0
