More Software Testing Unleashed episodes
Published 23 Apr 2026
Duration: 00:24:26
Flaky tests in CI/CD pipelines undermine reliability by causing intermittent failures due to shared state, timing issues, and environmental inconsistencies, requiring strategies like test exclusion, ownership, and prioritized fixes, alongside prevention through rigorous pre-CI testing and layered approaches, while AI aids debugging but not replacement, emphasizing iterative improvements over emotional attachment to code.
In this episode, I talk with Simon Stewart, professional software developer and former lead of the Selenium project for over 10 years, about one of th...
The podcast explores the challenges posed by flaky tests in software development, defined as tests that fail unpredictably due to a lack of repeatability. These tests undermine confidence in CI/CD pipelines by obscuring whether code changes are safe, while also consuming significant time investigating false failures. Key qualities of reliable tests include self-checking, fast feedback, isolation, and consistent results. The discussion highlights that flakiness often stems from shared state (e.g., database inconsistencies), race conditions, or environmental variables, emphasizing the need to root out systemic issues rather than merely masking symptoms.
Strategies for managing flaky tests include temporarily removing them from CI pipelines, assigning ownership to specific individuals for accountability, and prioritizing fixes for critical tests. Techniques like rerunning tests (up to three times) or implementing a "time-to-live" policy for unresolved flaky tests are suggested. Addressing root causes involves refactoring tests into a test pyramid structure, focusing on smaller, isolated tests, or even removing tests that lack value. The episode also touches on the role of AI in testing, which can generate test ideas or debug code but should not replace human judgment, due to its potential for overconfident or erroneous suggestions. Overall, the focus is on treating flakiness as an opportunity to improve system robustness and code reliability, rather than an unavoidable hurdle.
16 Apr 2026 From Nokia to iPhone: What Pen Testers Learned - Bartosz Czernic-Goawski
The historical evolution of mobile security, from unencrypted analog systems to 5G cryptography, highlights enduring vulnerabilities like app flaws, IoT risks, user behavior threats, platform security trade-offs, and the ongoing tension between innovation, usability, and privacy.
9 Apr 2026 Empowering Women in Software Testing - Line Ebdrup Thomsen
Highlighting women's underrepresentation in tech's software development versus higher presence in testing due to diverse entry paths and alignment with creativity, while addressing gender bias, stereotypes, and microaggressions, and emphasizing inclusive practices, non-technical skills, and leveraging testing's collaborative nature for growth.
2 Apr 2026 The Hidden Playwright Advantage Developers Miss - Maciej Kusz
Python offers broader flexibility for non-web and infrastructure testing with Playwright but requires extra setup, while TypeScript provides native integration with advanced web-specific tools like visual regression testing and Electron/mobile support, making the choice depend on project needs and team expertise.
26 Mar 2026 Stop the blame, keep the learning - Natalia Romanska
Learning from failure drives professional growth through objective analysis, a "fail-fast, learn-quick" mindset, self-reflection, feedback, balancing technical and soft skills, avoiding comparisons, and embracing failure's inevitable lessons.
19 Mar 2026 How Motherhood Made Me a Better QA Manager - Zaklina Polak Matanovic
Motherhood skills like communication, adaptability, and empathy enhance software testing and teamwork by fostering collaboration, proactive problem-solving, and inclusive environments through parallels in task delegation, accountability, and handling unpredictability.