More MLOps.community episodes

Speed and Scale: How Today's AI Datacenters Are Operating Through Hypergrowth thumbnail

Speed and Scale: How Today's AI Datacenters Are Operating Through Hypergrowth

Published 3 Feb 2026

Duration: 01:07:16

Experts discuss the challenges of building and maintaining complex AI infrastructure, including power availability, logistics, and component sourcing, and highlight the need for energy-efficient solutions and standardized management tools.

Episode Description

Kris Beevers is the CEO at NetBox Labs, working on turning NetBox into the system of record and automation backbone for modern and AI-driven infrastru...

Overview

The podcast examines the increasingly complex challenges involved in building and maintaining AI infrastructure, particularly as demand for computational power and specialized hardware such as GPUs continues to rise. It points out that while GPU limitations were once a primary concern, current obstacles are more related to power consumption, logistics, and the availability of necessary components. Energy demands have become a critical factor, with the discussion emphasizing the importance of sourcing reliable power, such as hydroelectric energy, and developing energy-efficient solutions to sustain large-scale AI operations.

Additionally, the podcast highlights the intricacies of managing extensive AI data centers, which require meticulous design, thorough documentation, and the seamless integration of both physical and logical infrastructure elements. It mentions the use of tools like Netbox to support a structured and data-driven approach to infrastructure management. However, the industry is still facing hurdles in standardization, automation, and the implementation of digital twin technologies to improve lifecycle management. The rapid pace of technological advancement, combined with a shortage of specialized expertise and limited knowledge sharing, adds further complexity to scaling and maintaining AI infrastructure effectively.

Recent Episodes of MLOps.community

9 Nov 2026 My AI Agent Bought Me A Car

Hermes agent uses reinforcement learning and trace-to-environment synthesis to enable continual self-improvement, balancing token efficiency with inference-time steering for better agentic performance.

2 Nov 2026 How Stanford Teaches AI Coding Now

AI agent development, verification loops, and go-to-market automation are reshaping software engineering and sales strategies.

29 Oct 2026 From Slop Code to Software Factories

"Tandem biking in Amsterdam's chaotic cycling culture led to a critique of AI-assisted coding's flaws, particularly its tendency to produce unmaintainable, poorly structured code, raising concerns about long-term software reliability."

22 Oct 2026 Token Maxxing Is Over and Here Is What Comes Next

"AI in software development offers benefits but faces challenges like nonsensical outputs and over-reliance; smaller, controlled models like Sonnet improve adoption, while measuring ROI and human-AI collaboration are key to success."

More MLOps.community episodes