9 Nov 2026 Distributed LLM Inference on Kubernetes with llm-d, Wasm, & TornadoVM
WebAssembly and Tornado VM enable efficient local inference, while LLMD optimizes distributed GPU usage and semantic routing for on-premises AI deployment.
More Podcasts by InfoQ episodes

Published 6 Apr 2026
Duration: 00:31:01
Mobile app security, advanced LLM prompt techniques, agent-based workflows with context management and RAG, event-driven architectures, AI in software development, and challenges like data silos and automation balance are explored.
In this episode, Thomas Betts and Adi Polak talk about the need for context engineering when interacting with LLMs and designing agentic systems. Prom...
The text explores advanced techniques in prompt engineering for large language models (LLMs), emphasizing the shift from role-based instructions to specialized environments and the use of few-shot examples to improve model learning. Key methods include "chain of thought" workflows, where models self-reflect through internal iterations, and constrained settings that define strict output parameters. It also highlights the importance of domain expertise, automation via scripting languages, and managing edge cases like limitations in mathematical modeling. Additionally, the evolution of workflows from manual human prompting to autonomous agent systems is discussed, where tools like Claude and newer platforms handle task planning and execution independently, reducing cognitive load and enabling real-time context adaptation for complex tasks such as code modifications or IP protection in open-source contributions.
Context management in AI workflows is framed as critical to avoiding errors, with techniques like hierarchical organization, selective context loading, and long-term memory systems to maintain efficiency. Challenges such as data silos, fragmented workflows, and context-switching are addressed through integration with event-driven architectures (e.g., Kafka and Flink), which enable scalable, real-time processing and automation. The text also touches on IP protection strategies, including AI-assisted code edits to prevent proprietary information leaks, and the development of open-source tools like Flink Streaming Agents for managing multi-agent workflows. Emphasis is placed on aligning AI capabilities with best practices in software development, from refining code quality to streamlining CI/CD pipelines through agent-driven task automation.
9 Nov 2026 Distributed LLM Inference on Kubernetes with llm-d, Wasm, & TornadoVM
WebAssembly and Tornado VM enable efficient local inference, while LLMD optimizes distributed GPU usage and semantic routing for on-premises AI deployment.
2 Nov 2026 Educating an Architect: A Conversation with Luca Mezzalira
Architects must evolve from technical designers to social-technical enablers, using domain-driven design to balance AI automation with human oversight in core systems.
12 Oct 2026 What Does It Really Mean To Program With AI: A Conversation with Joy Ebertz
"Explores software architects' evolving role in balancing technical and business challenges, AI's impact on modular architectures, risks of automation, and the need for human oversight in AI-assisted development."
5 Oct 2026 Future Cybersecurity: Hardware Memory Safety, Automated Governance and Post-Quantum Cryptography
"Challenges and advancements in AI, security, and software development are discussed, emphasizing governance, open-source maintenance, hardware security, automation, and regulatory compliance like the EU's Cyber Resilience Act, alongside post-quantum cryptography and AI's dual role in security."
28 Sept 2026 The AI Revolution Fails Without Psychological Safety For Developers: A Conversation with Erin Doyle
"Software architects must adapt to AI-driven shifts in system design, balancing automation with human oversight, team alignment, and ethical considerations in modern development."