Lightning Talk: SKAO: Next-Generation Radio Astronomy-Driven Big Data
summary
SKAO plans an observatory with 2 telescopes producing raw radio streams at terabytes per second and ~9 TB/s heading to science pipelines, requiring around 40 petaflops to meet one flagship science goal. The platform uses OCI images and Kubernetes/CNCF components with a layered, web‑controlled API; current build includes a CICD cluster serving 25 teams plus a GPU data‑processing cluster for prototyping. Systems are operational at development scale but not yet at full observatory throughput; needs include multi‑tenancy, job queuing and resource management.
AI-written summary · about
related talks
24mSKA Observatory: Reaching to the Stars and Beyond
11mProcessing TBs of Astronomy Data at Scale with the AC3 Horizon Research Project
45mFrom telescope to data centre: adventures in astronomical data pipelines
09mLightning Talk: Leveraging Large Scale Data Analytics on Cloud Foundry
10mPaco Nathan (Liber 118) Interview - OSCON 2014
36mRapid Processing of NASA Satellite Data Stored with Ceph
36mOptimizing Ceph Object Storage for Analytics and AL/ML Workloads - Overview and Future Plans
34mThe Data Analytics Platform or How to Make Data Science in a Box Possible