Unveiling the Test Champions: Comparing Testing Automation Systems for Embedded...
summary
Five systems are compared head-to-head: LAVA, Labgrid, Boardswarm, Beaker and Testing-in-a-Box, tested mainly on virtual devices over a few weeks (about two hours per week). LAVA handles batch jobs with a scheduler, callbacks and queue cleanup and is the best for automated patch processing; Labgrid and Boardswarm shine for interactive remote access (Labgrid richer, Boardswarm simple and Rust-based). Beaker wins on documentation depth. Hardware designs from Testing-in-a-Box are reusable but were not fully validated here. A hybrid approach and early community contact reduce setup time.
AI-written summary · about
chapters (7)
- 0:00Introduction
- 1:49Motivation
- 7:52Testing automation systems
- 16:56Use cases
- 22:07Experiences
- 29:47Recommendations
- 36:55Q&A
related talks
41mUnveiling the Test Champions: Comparing Testing Automation Systems for Embedded...
44mAutomation beyond Testing and Embedded System Validation
48mPrimer: Testing Your Embedded System - What is a ptest, Lava, Fuego and...?
33mAutomated Testing for Embedded Development: Next Generation Board Farming
55mShifting the Testing Role Pendulum
40mAutomated Full System Testing on Hardware with OpenQA
45mPanel Discussion | Test Automation Trends
41mAutomated Full System Testing on Hardware With OpenQA