On the Fly and On the Flight: Scientific Data Analysis Beyond the Beamline
summary
Python suite actually produces immediate XDI outputs and reproducible pipelines, uses xarray for named multi‑dimensional arrays (handles up to 100 detectors and >4,000 energy bins per scan), exposes processing via Jupyter notebooks, a PyQt desktop GUI with sliders, and typer CLIs. Pipelines auto‑trigger at scan end, allow on‑beamline QC and later reprocessing, serialize to netCDF/HDF, and run on the facility desktop or a laptop on a plane. Results are human‑readable tables and recalculable spectra.
AI-written summary · about
chapters (10)
- 0:00Introduction
- 0:41Synchrotron science
- 3:07Australian Synchrotron
- 6:34X-ray spectroscopy basics
- 9:47Python and Xarray processing
- 13:39Real-time beamline analysis
- 16:07User skill-level tools
- 20:00Remote data access
- 21:26Q&A
- 27:32Live Xarray demo
related talks
32mCommissioning tools at the Australian Synchrotron
35mClimate change analyzing remote sensing data with Python
42mMaking Sense Out of Flight Test Data with Python
42mApache Beam on Dask- Portable, Scalable, Scientific Python
31mBridging Scientific and Industrial Worlds for Advanced Signal and Image Processing
42mPython flying at 40,000 feet
44mRadio Astronomy Reduction Pipelines Using Python and Various Container Technologies
23mPython(x,y): diving into scientific Python