Inferact

How Open Source Became AI's Backbone | Inferact with a16z

How Open Source Became AI's Backbone | Inferact with a16z

Simon Mo, CEO of Inferact and lead maintainer of vLLM, discusses how open-source AI, exemplified by vLLM, transformed into critical infrastructure. The conversation highlights the technical complexities of serving LLMs, the evolving economics and licensing of open-weight models, the need for control over guardrails, and the rapidly disappearing capability gap between open and proprietary AI.