PyMODIS: processing 14 years of NASA's remotely sensed MODIS imagery
summary
Reimplements a fragile Idrissy macro pipeline as a tested Python pipeline named PyMODIS, ingesting MODIS NDVI at 250 m (19,000 × 14,000 tiles, 23 rasters/year ≈ 12 GB/year) and reprocessing about 14 years of imagery. Replaces 20-plus pages of undocumented macros with unit tests, GDAL and numpy, adds multiprocessing, fixes classification and temporal bugs, and processes a decade-plus archive in about two days on available HPC storage.
AI-written summary · about
chapters (12)
- 0:00Introduction
- 1:52Research interests
- 2:56Updating vegetation data
- 3:42MODIS instruments
- 8:08Data archives
- 8:53Addressee
- 10:05Magic numbers
- 11:19Word document
- 12:32Memory management
- 15:55Starting from scratch
- 18:43Performance
- 19:38Results
related talks
34mGeoscience Big Data Computing with Python
42mMaking Sense Out of Flight Test Data with Python
37mMosaicking the Earth every day
28mPython for Planet Earth: Climate Modeling and Sustainability.. with Drishti Jain
40mData-centric exploration using intake, dask, hvplot, and more
38mScaling Interactive Pandas Workflows with Modin
36mGeoMonitoring with Python: Innovative Solutions for Latin America’s Challenges
31mOpenDataCube - Petabyte Scale Satellite Imagery Processing in Python