Tokenless

Llama

Why Reflection AI Is Making the Open Intelligence Bet - and What It Means for Deploying Models

Why Reflection AI Is Making the Open Intelligence Bet - and What It Means for Deploying Models

Joe Spisak of Reflection discusses why open models and open intelligence matter, covering RL-driven customization, environments as the new dataset, the OpenEnv project, PyTorch and Llama lessons, inference scaling, and the case for ecosystem control and open safety.

Make some noise: Teaching the language of audio to an LLM using sound tokens

Make some noise: Teaching the language of audio to an LLM using sound tokens

Shivam Mehta from KTH presents a method for teaching Large Language Models (LLMs) to understand and generate audio by treating it as a discrete language. The approach involves a two-step process: first, creating an ultra-low bitrate (0.293 kbps) audio representation using a causal variational autoencoder, and second, fine-tuning a Llama 7B model with these audio tokens using LoRA.