9 Nov 2026 Distributed LLM Inference on Kubernetes with llm-d, Wasm, & TornadoVM
WebAssembly and Tornado VM enable efficient local inference, while LLMD optimizes distributed GPU usage and semantic routing for on-premises AI deployment.
More Podcasts by InfoQ episodes

Published 18 May 2026
Duration: 00:52:08
AI adoption in architectural decision-making emphasizes trade-offs between efficiency and complexity, challenges of ambiguous requirements, context-driven engineering, frameworks like the Intent Integrity Kit for iterative clarity, architect roles in managing systems and stakeholder dynamics, and the need to balance AI capabilities with human oversight amid ethical and technical limitations.
In this podcast Michael Stiefel spoke to Baruch Sadogursky about software architecture in the age of agentic AI. Large Language Models can function, a...
The discussion centers on the interplay between AI adoption, architectural decisions, and system design complexities. Key themes include the long-term implications of current AI and architectural choices, the challenges of navigating rapid technological change, and the role of context engineering in enabling AI agents to interpret human intent accurately. Unlike traditional prompt engineering, which relies on vague instructions, context engineering emphasizes structured frameworks for defining requirements, ensuring clarity, and creating iterative feedback loops. This approach draws parallels to historical efforts to bridge human language and programming, leveraging AIs improved ability to resolve ambiguities. The conversation also addresses how architects must manage trade-offs, client ambiguity, and the evolving responsibilities of ensuring AI systems align with human-defined goals.
A critical focus is on the necessity of context artifactscombinations of skills, rules, and scriptsto guide AI agents effectively, alongside the ethical and legal complexities of AI errors, including unclear liability chains. The discussion highlights the importance of architects in orchestrating AI-powered systems, particularly in managing microservices and emergent system properties. While AI agents can handle incremental tasks and improve code quality through predictive analysis, architects remain essential for managing complexity, ensuring scalability, and addressing unresolved challenges like governance frameworks. The future of AI in architecture is framed as a collaborative evolution, balancing agentic capabilities with human oversight to refine systems through feedback and iterative improvement.
The text also underscores inherent complexities in software and architecture, which cannot be eliminated but must be systematically managed through informed trade-offs. It emphasizes the transformative potential of AI in reducing friction during implementation and mediating stakeholder interactions, though ethical concerns about AIs future autonomy loom. Ultimately, the transition toward proactive, context-driven AI engineeringrooted in rigorous frameworks, explicit specifications, and continuous evaluationsignals a shift toward more predictable and scalable system design. Architects are portrayed as irreplaceable in defining and managing these processes, ensuring alignment between human intent and machine execution while navigating the evolving landscape of AI capabilities.
What if you implemented a context artifact with explicit skills, rules, and scripts to guide AI agents in your solo project?
What if you enforced a three-way conversation between your AI agent, client, and yourself to clarify requirements before proceeding?
What if you made your specification (spec) the single source of truth for all code generation, updating it before writing any code?
9 Nov 2026 Distributed LLM Inference on Kubernetes with llm-d, Wasm, & TornadoVM
WebAssembly and Tornado VM enable efficient local inference, while LLMD optimizes distributed GPU usage and semantic routing for on-premises AI deployment.
2 Nov 2026 Educating an Architect: A Conversation with Luca Mezzalira
Architects must evolve from technical designers to social-technical enablers, using domain-driven design to balance AI automation with human oversight in core systems.
12 Oct 2026 What Does It Really Mean To Program With AI: A Conversation with Joy Ebertz
"Explores software architects' evolving role in balancing technical and business challenges, AI's impact on modular architectures, risks of automation, and the need for human oversight in AI-assisted development."
5 Oct 2026 Future Cybersecurity: Hardware Memory Safety, Automated Governance and Post-Quantum Cryptography
"Challenges and advancements in AI, security, and software development are discussed, emphasizing governance, open-source maintenance, hardware security, automation, and regulatory compliance like the EU's Cyber Resilience Act, alongside post-quantum cryptography and AI's dual role in security."
28 Sept 2026 The AI Revolution Fails Without Psychological Safety For Developers: A Conversation with Erin Doyle
"Software architects must adapt to AI-driven shifts in system design, balancing automation with human oversight, team alignment, and ethical considerations in modern development."