More Open Source Security episodes

How to actually test a disaster plan with David Bernstein thumbnail

How to actually test a disaster plan with David Bernstein

Published 4 May 2026

Duration: 34:58

A three-part disaster recovery framework emphasizing simplicity, clear roles, and collaboration, utilizing structured testing via HSEEP, real-world validation, and continuous improvement through exercises, while addressing pitfalls and balancing realism with psychological safety.

Episode Description

Josh and David finish up the disaster recovery and emergency planning trilogy. In this one David tells us how to test the plan he told us how to build...

Overview

The podcast discusses disaster recovery and emergency planning, emphasizing practical, simplified approaches to creating effective strategies. Key principles include the "KISS" methodology, which advocates for clear, straightforward plans that outline roles and responsibilities without unnecessary complexity. Post-plan actions focus on testing through tabletop exercises, which simulate incidents to identify gaps in preparedness. These exercises range from simple discussion-based scenarios to more complex functional simulations, balancing detailed realism with the need for focus. The Homeland Security Exercise and Evaluation Program (HSEEP) is highlighted as a resource for structured testing, stressing a continuous improvement cycle: plan, train, exercise, evaluate, and refine. Real-world testing is critical, as illustrated by a data center incident where a generator failure during a test triggered a real crisis, underscoring the need to validate systems like failover processes in controlled environments. The discussion also distinguishes between hot, warm, and cold disaster recovery sites, stressing the importance of verifying physical and operational readiness through exercises before assuming a plans viability.

The podcast further explores the design and execution of emergency preparedness exercises, emphasizing objective-driven scenarios that target specific goals, such as response time metrics, rather than arbitrary complexity. Clear terminology, like differentiating "vulnerability" from "exploit," is highlighted to prevent misunderstandings during high-stakes situations. Gamification techniques, such as using dice or cards to simulate unpredictability, are discussed as tools to test reactions but caution against letting them distract from core planning objectives. No-fault exercises are prioritized to evaluate processes rather than individual performance, ensuring constructive feedback over blame. Common pitfalls, such as overemphasizing perfection or creating overly stressful environments, are warned against to maintain the focus on learning and improvement. The discussion also touches on psychological factors, like avoiding unfair pressure on participants and addressing diverse personalities within teams. Finally, it connects disaster planning to broader contexts, including using fictional scenarios like Star Trek episodes to explore real-world security risks through frameworks such as MITRE ATT&CK, illustrating how creative approaches can deepen understanding of enterprise security challenges.

Recent Episodes of Open Source Security

15 Jun 2026 Sustaining Open VSX with Mike and Thabang

Eclipse Foundation's OpenVSX, a VS Code extension repository, surged to 600M monthly downloads, evolved to a commercial model with enterprise SLAs and security teams, while addressing scalability, open-source balance, and funding challenges for AI expansion.

8 Jun 2026 Hacking your CI/CD with Francois Proulx

Critical vulnerabilities in open source CI/CD pipelines, including hijacking and supply chain attacks via social engineering or compromised builds, are highlighted through incidents like TJ Actions and Ultralytics, with mitigation strategies emphasizing secure credentials, externalized workflows, threat modeling, and tools like *Smoked Meat* and *Bagel* to enhance incident response and supply chain security.

1 Jun 2026 Open source verification with Sal Kimmich

Cybersecurity challenges include complex application ecosystems, overlooked kernel vulnerabilities, supply chain risks, and systemic risks from under-resourced organizations prioritizing surface-level controls, alongside calls for regulatory reforms, proactive threat modeling, secure development practices, and addressing tribal nations' unique legal and sovereignty concerns.

25 May 2026 Vulnerability disclosure with Casey Ellis

The evolution of vulnerability disclosure highlights challenges in prioritizing critical issues, outdated legal frameworks, and the role of initiatives like Disclosed.io in standardizing policies, alongside AI's impact on detection, open-source risks, triage complexities, and the need for collaboration and transparency to address systemic security barriers.

18 May 2026 F-Driod the open app store with Hans

F-Droid, an open-source Android app store modeled on Linux distributions, emphasizes security and transparency through source-code verification, contrasting with fragmented alternatives and corporate control, while addressing Android's ecosystem challenges and efforts to preserve open-source principles.

More Open Source Security episodes