Llm benchmarks

Don't Trust Your AI Agents. Test Them Like a Scientist — Stephanie Jarmak, Omni Analytics

Don't Trust Your AI Agents. Test Them Like a Scientist — Stephanie Jarmak, Omni Analytics

Stephanie Jarmak, who moved from astronomy into building coding benchmarks and agent evals, argues that most agent evaluations are easy to misread. She covers how harness choice can swamp model differences, why public benchmarks serve shortlisting rather than decisions, how to design experiment-style evals with realistic tasks, repeated runs, and full traces, and how to set quality gates, manage human review load, verify agent records, and treat production as the final test.

GLM-5.2: Open Weights, Near-Frontier Intelligence — Zixuan Li, Z.ai

GLM-5.2: Open Weights, Near-Frontier Intelligence — Zixuan Li, Z.ai

Zixuan Li, head of Z.ai, introduces GLM-5.2 and explains the company's history, from the 2021 GLM paper to a new high thinking level and near-frontier benchmark results. He makes the case for open weights through enterprise on-prem deployment, domain fine-tuning and community co-design, and closes by announcing Z Code, an open-sourced coding harness that works with other frontier models.