Tokenless

H100

Buying GPUs Should Work Like Buying Stocks — Carmen Li, Compute Exchange

Buying GPUs Should Work Like Buying Stocks — Carmen Li, Compute Exchange

Carmen Li, CEO of Compute Exchange and Silicon Data, makes the case for treating GPU procurement like exchange trading. She covers the neutral, verified marketplace model, its reserved, forward, token and secondary server products, and the RFQ routing system. She then examines Silicon Data's forward curves for H100 and B200, the market's expectation of rising prices, and how used GPUs are holding value well above standard depreciation.

Can LLMs Write Fast Multi-GPU Kernels? — Simran Arora, Together AI

Can LLMs Write Fast Multi-GPU Kernels? — Simran Arora, Together AI

Simran Arora discusses the critical bottleneck shift in large AI workloads from GPU compute to inter-GPU communication. Her team's solution, ParallelKittens, offers a set of primitives to optimize multi-GPU kernels by leveraging fundamental transfer mechanisms and compute-communication overlapping. They introduce ParallelKernelBench, a benchmark to evaluate AI models' ability to generate such kernels, revealing that while models can handle syntax, they struggle with deeper reasoning about communication patterns and hardware trade-offs.