End to end testing a world of web, mobile & desktop apps
summary
A testing setup for UI components used in ~50 Microsoft 365 apps and ~300 packages runs TypeScript unit tests, Storybook component checks and platform-specific e2e tooling (Espresso, XCUITest, WinAppDriver) plus browser automation via Playwright. A custom media e2e framework opens a page once, runs many scenarios and captures screenshots; initial pixel comparisons with Pixelmatch are replaced by screenshot-gif using 32-bit integer diffs to process thousands of screenshots per minute. Page normalization (inject CSS, blackout images, collapse animations) reduces noise so visual diffs are actionable.
AI-written summary · about
chapters (19)
- 0:00Introduction
- 1:15About Mathieu Henri
- 4:25Scripting
- 6:06Overview
- 6:58Software Testing
- 11:06Component Testing
- 12:36Component Testing from Media
- 13:59Testing Complete Users
- 17:13Test Framework
- 23:44Platform Specific
- 24:45Pixel Match Example
- 26:37Screenshots
- 27:07Screenshot Gift Package
- 29:00Accept or take
- 29:33Thirdparty components
- 31:19Test results
- 32:02How to get help
- 32:24Summary
- 33:35Outro
related talks
31mEnd to end testing a world of web, mobile & desktop apps
01h 02m1,2,3… testing: is this thing on(line)? Meet your new Microsoft Testing tools
35mState of end-to-end testing for modern web applications
45mTesting the web without testers — success or failure
40mEnd to End Automation from a Developer Standpoint
35mTesting in Frontend World
38mModern Web Testing: Going Beyond Selenium
27mVisual UI Testing – Testing the Last Mile