Panel Discussion: QE at Enterprise Scale - What Will a QE Org Look Like in 2027?
summary
Claims that AI agents produce test suites, run pipelines and triage bugs are already live: teams train an in-house code review agent, shift from embedded QA to pooled flex squads, and use a SpaceX-style launch-commit dashboard as a gate. Concrete metrics become central — tracking change failure rate, defect removal efficiency, false positives and agent consistency — and hiring/upskilling focuses on system design, DevOps, release process and the ability to do a task then train an agent to do it.
AI-written summary · about
chapters (30)
- 0:00Panel Opens: What a QE Org Looks Like Today and in 2027
- 1:38Panel Intros - Impu Chunchegowda, Senthil Kannan, and Todd Lemmonds
- 3:09How Quality Organizations Are Structured Two Years Into AI
- 4:09Exploration Phase: AI as an Accelerator, Engineers as Critical Thinkers
- 5:41The Hockey Stick Started in January When Agentic Engineering Landed
- 6:43QA on the Back Foot: Keeping Up With the Volume of Generated Code
- 7:44'There Will Be No More Test Engineers - Everyone Becomes a QA Architect'
- 8:44From Embedded QA to Pooled, Flexed Teams With In-House Agents
- 10:16Which Old Assumptions Broke First
- 11:46The Fading Manual and Exploratory Tester Role
- 13:23Positioning QE From Cost Centre to Value Driver
- 14:26Developer Velocity Outpacing Automation - and What QE Does About It
- 15:59The Career Path of the Exploratory Tester
- 16:29Why Exploratory Testing Survives: Debugging and Feeding Back to Dev Agents
- 17:29The Bigger Impact Lands on Developers and DevOps, Not Testers
- 19:01Who Takes the Go/No-Go Decision in an Agentic World?
- 19:32The SpaceX Launch Commit Dashboard as a Quality Gate Model
- 21:04QA Still as Gatekeeper: Integration Tests Inside the Dev Pipeline
- 22:36A Governance Layer and a Culture of Combined Responsibility
- 25:09New Metrics: False Positives, Evaluation Layers, Predictable Turnaround
- 27:39Change Failure Rate and Defect Removal Efficiency as the New Proof of QE Value
- 29:09New Metrics for Testing the Agents Themselves
- 30:43Testing Non-Deterministic Agents: Consistency, Hallucination, Accuracy
- 33:20If an Agent Is Right 95% of the Time, Is That Good Enough?
- 34:51Better an Agent That Says 'I Can't' Than One Confidently Wrong
- 35:51How Much Evidence Is Enough - and Why Agents Need More Than Humans
- 38:26The Recursive Loop: How Are Your Agents Learning From Their Mistakes?
- 39:57The 2027 Org: Expanding, Contracting, or the Same?
- 41:28Upskilling: System Design, DevOps, Release Process, Domain Depth
- 46:34The Skill That Lasts: Do the Task, Then Train an Agent to Do It
related talks
46mQA to QE: Scaling Quality with Ownership, Code, and Culture
47mPanel Discussion: QE Strategic Shift: What's Changing with AI, Automation, and Speed?
22mBeyond Bugs: How AI turns QA into Full-Circle Engineers
33mThe Autonomous Enterprise
59mPanel Discussion: Strategies for Scaling AI in Quality Engineering
28mWhy Software Quality Is the Key to Scaling AI Development
32mKeynote: AI & GenAI in Quality Engineering: Crawl, Walk, Run
30mAgentic QA vs LLM Dev: A Live AI Showdown in the DevOps Arena