Android Benchmarking and other stories

on YouTube ↗33m

" summary

Shows how to benchmark a real app using Jetpack micro and macro benchmarks and the Android Profiler, compares outputs (microbenchmarks for tight CPU hot spots, macrobenchmarks producing JSON with min/median/max and the macrobenchmark startup metric), and demos the new in‑app JankStats (released 2022‑02‑09) that reports per‑frame nanos and an isJank boolean and can aggregate before upload. Describes storing results, running on real devices or Firebase Test Lab, and detecting regressions with a sliding-window step-fitting algorithm to avoid false positives while alerting on regressions or unexpected improvements, using Android Profiler traces to guide what to benchmark.

AI-written summary · about

" chapters (11)

1. 0:00Introduction and speakers
2. 1:10What is Android benchmarking
3. 4:22Android profiling tools
4. 5:45Microbenchmarking basics
5. 8:16Macrobenchmarking overview
6. 10:45Introducing JankStats
7. 13:54Detecting regressions in CI
8. 21:10Regression detection approaches
9. 25:02Statistical regression detection
10. 29:13Key takeaways and resources
11. 31:20Q&A and closing

" related talks

• 33mAndroid Benchmarking and other storiesEnrique López Mañas, Iury Souza · droidcon New York 2022
• 44mAndroid Benchmarking and other storiesEnrique López Mañas, Iury Souza · Android Makers 2022
• 40mMonitor App performance using Jetpack BenchmarkSagar Das · droidcon New York 2023
• 43mBenchmarking your applicationXavier F. Gouchet · Android Makers 2020
• 42mPerformance Paradox: Navigating the Complexities of Mobile App OptimisationSai, Srini · Appium Conf 2024
• 20mMeasure What Matters with Jetpack Benchmark (Lightning)JB Lorenzo · droidCon Berlin 2019
• 39mAndroid App Performance in a NutshellBen Weiss · Droidcon London 2023
• 05mWorkshop: Inspect and improve app performanceBen Weiss, Tomáš Mlynarič · droidcon Berlin 2022