~/talk

Tests Are What You Want, What You Really Really Want

on YouTube 31m
Talkat CNCF Maintainer Summit Europe 2025 · on Monday, 2025-03-31· at 13:10· Level 3 | ICC Capital Suite 14-16· [testing]

speakers

name:Daniel Hiller
links:none on file
name:Ryan Hallisey
links:none on file

resources

video:https://youtu.be/TLkbHD70lb4
slides:none on file

summary

Project runs >1,000 E2E tests with ~35 lanes per PR, using Ginkgo and Gomega, Prow and TestGrid plus a small custom heat‑map tool to rank flakiest tests. Flake detection experiments use feature vectors and a random‑forest classifier (implementation PR in progress). Scale tests run per‑100 VMI batches, scraping Prometheus; observed patch requests rise from ~200 to ~400 per 100 VMIs. Simulation uses Quark and kubemark/cluster‑loader to scale without real nodes.

AI-written summary · about

chapters (7)

  1. 0:00Testing goals discussion
  2. 3:54CI pipeline tooling
  3. 8:13Flaky tests detection
  4. 15:26Test failure reporting
  5. 20:28CRD scale testing
  6. 28:16Large-scale simulation
  7. 31:07Q&A

related talks

~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.