Overview of Device Farms for Mobile Testing

on YouTube ↗39m

" summary

Compares four mobile device-farm providers (Kobiton, Sauce Labs, AWS Device Farm, Bitbar) by concrete behavior. Kobiton is Appium-only with a fixed Appium version, inexpensive, provides session video/screenshots and device logs; Sauce Labs offers automated quality scans (Google Monkey), many emulators + real devices and CI plugins; AWS requires server-side archive execution (can’t run tests locally) and returns video plus performance graphs; Bitbar supports many frameworks, provides video, perf graphs and HTTP logs and an AI testbot but is the most expensive. The talk also notes varying parallelism models (per-device full-package vs split-test) and practical issues like Appium updates and personal-data cleanup.

AI-written summary · about

" chapters (27)

1. 0:00Introduction
2. 1:14Device farms purpose
3. 3:40Emulators vs real devices
4. 4:24Cloud device farms history
5. 4:46Kobiton platform overview
6. 7:56Kobiton CI/CD setup
7. 8:37Kobiton integrations
8. 9:41Sauce Labs platform overview
9. 10:46Sauce Labs setup reports
10. 12:33Sauce Labs CI/CD integration
11. 13:15Sauce Labs quality reports
12. 15:00AWS Device Farm overview
13. 16:27AWS Device Farm execution
14. 18:15AWS Device Farm setup reports
15. 20:25AWS Device Farm CI/CD
16. 21:07AWS Device Farm local runs
17. 21:30BitBar platform overview
18. 22:32BitBar test execution
19. 24:00BitBar reports features
20. 25:37BitBar CI/CD integration
21. 25:59BitBar AI testing
22. 27:51Parallel testing
23. 28:53Platform comparison
24. 29:59Automation framework support
25. 30:40Device farm security
26. 31:23Appium update issues
27. 32:29Q&A

" related talks

• 29mPros and Cons of Device Farms Available for Androidduck · DroidKaigi 2018
• 38mMobile Device Farms Demystifying Testing Strategies Between Theory and Real World Practice - SergioSergio Olmos · SeleniumConf & AppiumConf Valencia 2025
• 14mMobile Farming for PerfectionSasha Denisov · CPH DevFest 2024
• 39mTaming Public Device Clouds for App TestingShauvik Roy Choudhary · Android Summit 2018
• 45mPanel Discussion | Test Automation TrendsYevheniia Hlovatska, Thomas Carpentier, Ellinor Kwok, Kerim Satirli · TestCon Europe 2021
• 13mAWS for Testing – Top 3 Use CasesSujith Sukumaran · TestFlix 2022
• 26mMobile Test Automation Frameworks – From the Basics to UsageAnna Kelemen · HUSTEF 2018
• 35mDockerization of a Real Mobile Device Farm and Scalable QA Automation EcosystemAlexei Khursevich · DelEx Conf 2018