Assessing the availability, reproducibility and reuseability of research softwa...
summary
Compares the PL community’s ACM artifact badges workflow with FAIR-based assessment used in open science and climate work, cites CMIP model-comparison tooling and the Earth System Model Evaluation Tool as concrete evaluators, and describes a metrology project building digital calibration certificates and software in the Links language. Notes the ACM reproducibility/replicability definitions were swapped until August 2020, flags rising misuse of paper reviewers for artifact checks, and urges funding major research software as infrastructure.
AI-written summary · about
chapters (8)
- 0:00Introduction
- 1:06Research software goals
- 8:12Climate science practices
- 12:04Assessment challenges
- 14:54Artifact review process
- 17:07Improving assessment
- 18:52Software engineering focus
- 20:48Q&A
related talks
19mR Markdown The bigger picture
24mHow to Write Reproducible Manuscripts
23mCan Metadata Standards play nicely?
21mAuthoring Tools for Transparent Climate Reporting
17mOddly Satisfying - Find delight in the mundane
42mStories in Code
15mOpen Access for Museum Collections and Research
38mAgile, Lean & Rugged - The Paper Edition