Craig Tavares, COO of Buzz HPC, provides an in-depth look at the complexities of building and scaling GPU cloud infrastructure for AI. He covers the critical role of renewable energy and strategic location, the evolution of data center design to handle extreme power densities, the importance of a strong partnership with NVIDIA, and the rise of sovereign mandates shaping the future of AI cloud services.
The panel discusses KPMG's 100-page prompt for its TaxBot, debating the future of prompt engineering versus fine-tuning. They also analyze OpenAI's potential move into selling cloud infrastructure, the impressive capabilities of Google's new image model, Nano-Banana, and new AI-powered fan experiences at the US Open.
Fal co-founder Burkay Gur and head of engineering Batuhan Taskaya discuss their journey building a high-performance generative media cloud. They cover their strategic pivot to media models, core optimization principles born from early GPU scarcity, and the development of a customer-obsessed culture to navigate the fast-paced AI model landscape.