More Podcasts by InfoQ episodes
Published 27 Apr 2026
Duration: 00:40:47
Challenges in deploying AI from proof-of-concept to production highlight engineering gaps, with QuestDB's three-tier storage (real-time, query, archival) and Java/C++/Rust optimizations enabling scalable time-series data handling, though facing Java warmup, code generation, and hardware integration hurdles.
In this podcast, Jaromir Hamala, a seasoned Java engineer specialising in high-throughput data systems, shares his thoughts on how developers can tack...
The podcast discusses challenges in deploying AI systems into production, emphasizing the gap between proof-of-concept development and reliable, scalable implementations. It highlights QuestDB, a time-series database optimized for high ingestion rates and bridging real-time data with data lakes. QuestDB employs a three-tier storage architecture: Tier 1 handles real-time ingestion via an append-only write-ahead log, Tier 2 organizes data by time for efficient querying (e.g., binary search over time windows), and Tier 3 stores older data in cost-effective formats like Parquet in object storage (e.g., S3). The database is tailored for machine-generated data (e.g., IoT, financial systems), prioritizing scalability and external tool integration to avoid data lock-in. Key concepts include time-series databases treating time as a primary dimension for aggregation and tiered storage balancing speed, query efficiency, and cost.
The technical implementation focuses on Java as the core language for QuestDB, with 90% of the codebase in Java and performance-critical components in C, C++, and Rust. Unorthodox Java practices, such as object pooling and minimizing garbage collection, enable high ingestion rates (millions of rows per second). A custom JIT compiler is used for SQL filters, though limitations like lack of ARM support in the C++ backend and slow initial execution of generated code pose challenges. Future plans include transitioning to Javas Vector API for ARM compatibility and leveraging projects like Valhalla to improve memory layout control. Alternatives to JNI, such as Javas Panama project, are explored for safer native memory access, while risks of unsafe memory manipulation in Java are acknowledged.
The discussion extends to low-level system programming, including debugging a Linux kernel deadlock encountered during profiling, and optimizing performance through hardware-aware techniques like exploiting CPU parallelism. The role of AI tools in code exploration and analysis is also covered, with examples of using AI for investigating compilers, security vulnerabilities, and log analysis. However, challenges include balancing AI-driven efficiency with foundational programming discipline and avoiding over-optimization in general-purpose systems. Overall, the content underscores the interplay between hardware understanding, software design, and emerging technologies like AI in addressing performance and scalability challenges.
4 May 2026 Roq: Leveraging Quarkus to Build Static Sites at the Speed of Go
Java's resurgence is fueled by performance gains, modern frameworks like Quarkus, and native compilation, exemplified by Rooka lightweight static site generator leveraging Quarkus for dynamic rendering, Markdown content, and streamlined workflows, with future AI integration and open-source advancements.
20 Apr 2026 Engineering Stable, Secure and Scalable Platforms: A Conversation with Matthew Liste
Systems engineering and software development's evolution emphasizes hands-on learning, mentorship, and intuitive experience, while addressing AI's impact on apprenticeships, balancing abstraction with deep system understanding, managing risks in high-stakes sectors, navigating innovation-stability trade-offs, scaling complex systems, evolving engineer roles, customer feedback loops, fostering continuous learning and collaboration, and prioritizing craftsmanship, systemic thinking, and the synergy between technical precision and practicality.
13 Apr 2026 How SBOMs and Engineering Discipline Can Help You Avoid Trivys Compromise
Strengthening mobile app security beyond minimal standards, leveraging Software Bill of Materials (SBOM) to address supply chain risks under legislative mandates like U.S. Executive Orders and the EU's Cyber Resilience Act, and utilizing tools such as Cyclone DX and SPDX for dependency tracking, compliance, and mitigating supply chain attacks through improved tooling and practices like OIDC authentication.
6 Apr 2026 Context Engineering with Adi Polak
Mobile app security, advanced LLM prompt techniques, agent-based workflows with context management and RAG, event-driven architectures, AI in software development, and challenges like data silos and automation balance are explored.
31 Mar 2026 Failure As a Means to Build Resilient Software Systems: A Conversation with Lorin Hochstein
The text highlights the importance of learning from real-world failures over synthetic chaos experiments to build resilient software architectures, emphasizing systemic resilience engineering, adaptive strategies, and continuous improvement in complex systems.