Openbytes Builds Open Dataset Standards and Schema Aiming to Bring Transformational Changes to AI by Making Open Datasets More Available and Accessible
Talkat Open AI + Data Forum @ Open Source Summit North America 2022 · on Tuesday, 2022-06-21· at 12:00· Room 408/409 (Level 4), JW Marriott Austin, 110 E 2nd Street Austin, TX 78701·
summary
Claims a unified dataset schema called Portex schema language that lets projects import and compose types from other GitHub repos, instantiate templates (e.g., VOC backbone → dog vs cat) and embed tables inside table cells to avoid joins. Implementation targets columnar memory using Apache Arrow and exposes a pandas-like DataFrame API; docs are live, the language is near first release and dataset conversions are ongoing, so tooling is usable but still work in progress.
AI-written summary · about
chapters (7)
- 0:00Start
- 2:10Agenda
- 3:23State of the Open Datasets
- 11:15What Is a Unified Representation
- 20:14What Is Vortex
- 22:17Key Features of Products
- 29:26What Can Happen Next to Portex
related talks
34mOpenDataology - An Open Source Dataset License Compliance Project Initi...
24mBuilding Open Data Platforms, an Insider's Perspective
35mTen years of building open source standards.
14mOverture and OpenStreetMap: Expanding Open Map Data
29mOpen Data
06mOpen by design, open for data
22mTowards Open Data Cube 2 0
33mThe advent of the open data lake