Deep dive into Prime Intellect's open-source ecosystem for post-training LLMs, covering the modular Verifiers V1 environment design, the asynchronous and scalable Primer RL training framework, and the Lab platform for hosted training and fine-tuning. Learn about advanced reward systems, the interception server pattern, and tokenization control with the Renderers library, all designed to enable frontier agentic model development.
This talk introduces TurboQuant, a training-free compression method from Google Research that reduces embedding memory footprint by 5x (from 32-bit to 3-4 bits) without losing search quality. It details how TurboQuant works through scalar quantization and a crucial one-bit error correction step, QJL, enabling agents to remember more on existing hardware by optimizing both KV cache and RAG vector stores. A live demo showcases its effectiveness, making it a vendor-neutral solution for efficient AI agent retrieval.
Ronuk Malde, CEO of Trajectory.ai, discusses his journey from building AI coding agents at Windsurf to his current focus on continual learning for enterprise AI. He shares insights on leveraging real-world user data, the unique challenges of model acquisition, and how Trajectory.ai's platform, powered by innovations like scaled SDPO and a novel training stack, enables dynamic, always-learning AI models for diverse industries from legal to finance.