Prompt engineering

Aug 10, 2026

5 Best Practices for Building AI Agent Skills

This video outlines five essential best practices for developing reliable, secure, and effective AI agent skills. It covers optimizing skill triggering through descriptive metadata, leveraging real-world domain expertise over generic LLM output, managing context windows efficiently by writing lean skills and using progressive disclosure, implementing deterministic logic with scripts for fragile operations, and critically vetting all skills for security vulnerabilities before deployment. These practices are crucial for professionals building robust agentic systems.

Aug 08, 2026

Anthropic's CCA Exam as a Field-Guide for Agentic Engineering — Frank Coyle, UC Berkeley

Frank Coyle demystifies the Claude Certified Architect exam by dissecting key scenarios and highlighting common anti-patterns in Agentic AI design. He provides actionable best practices, emphasizing effective tool use, context management, specialized agent architectures, and cost-saving techniques, all centered on understanding what to avoid to build robust LLM applications.

Aug 06, 2026

The State of Model Routing — NVIDIA, Cognition, OpenRouter

A deep dive into model routing strategies for AI/ML production, featuring experts from Cognition, OpenRouter, and NVIDIA. Key topics include optimizing costs with multi-model systems, delegating tasks between frontier and smaller models, managing context efficiently (sidekicks, compaction), and adapting to dynamic task complexities. The panel discusses the fragility of naive routing, the cost implications of in-distribution vs. out-of-distribution tasks, and the evolution of auto-routers driven by real-world usage patterns like OpenClaw's heartbeats. Insights also cover NVIDIA's Flex Run for dynamic model sizing, hallucination probes for detecting model limitations, and the future of hybrid local/cloud routing and model collaboration.

Jul 31, 2026

Benchmarks: The Good, the Bad, and the Ugly — Ali Khial, G2i

Ali Khial exposes critical flaws in popular coding benchmarks, revealing how ambiguous instructions, weak verifiers, and model 'reward hacking' create a disconnect between reported performance and real-world utility. He argues that this leads to a "trust gap" where engineers disregard leaderboards. Khial then outlines five principles for building trustworthy, production-grade benchmarks, emphasizing human-authored instructions, holistic grading, economic value, contamination-free design, and informative leaderboards, urging software engineers to contribute to their improvement.

Jul 29, 2026

Persona Engineering: A Field Guide to AI Synthetic Personas — Ishan Anand, InsightSciences.ai

Ishan Anand discusses synthetic personas for market research, drawing parallels to weather forecasting. He outlines three key failure modes—latent confounders, prompt sensitivity, and difficulty predicting actions—and explores techniques like fine-tuning and calibrated prompting to overcome them. Anand stresses the importance of validating personas against human data using distributional metrics and establishing a "noise floor" based on human-to-human consistency, advocating for their use as economic actors and complements to, rather than replacements for, human research.

Jul 26, 2026

DeepSWE: A Contamination-Resistant Coding Benchmark — James Shi, Datacurve

DeepSWE is a novel benchmark for evaluating AI models on software engineering tasks. It features 113 original, long-horizon problems from real open-source repositories, designed to resist contamination and provide clearer differentiation between models. The benchmark highlights unique failure modes and strengths of models like Claude and GPT, emphasizes realistic prompt design, and uses program-based verifiers focusing on observable behavior.