Posts

Why won’t AI agents just follow the rules?

Why won’t AI agents just follow the rules?

This podcast episode tackles critical cybersecurity issues in AI, examining why AI agents defy rules and the necessity of deterministic external controls. It highlights the severe lack of security in agentic skill marketplaces (OWASP Top 10), where "natural language is executable" and the "rush to market" overlooks basic hygiene. The discussion also covers how AI disrupts bug bounties, leading to lower payouts and "AI slop" reports, potentially pushing researchers to the dark market. Finally, it introduces ThreatXtension, an AI-powered open-source tool to detect malicious browser extensions.

Why 95% of All AI Projects Fail - Boris Scharinger | Podcast #174

Why 95% of All AI Projects Fail - Boris Scharinger | Podcast #174

Boris Scharinger, Industrial AI Strategist at Siemens and author of "Industrial AI: From Pilot to Profit," discusses why 95% of AI proofs of concept fail in industrial settings. He highlights the 5-10x cost multiplier from pilot to production, the critical role of the "harness" around AI models, and the unique challenges of data access and legacy systems in physical environments. Scharinger advocates for a two-tiered investment strategy, separating foundational data capabilities from use-case-specific ROI, and addresses cultural resistances from engineers. He provides guidance on differentiating commodity from strategic AI applications and how to effectively scale industrial AI for profit.

Deep dive on LLM Inference at Scale — Harshul Jain, Audible & Tanmay Sah, Independent AI Researcher

Deep dive on LLM Inference at Scale — Harshul Jain, Audible & Tanmay Sah, Independent AI Researcher

A workshop by Harshul Jain and Tanmay Sah breaks down LLM inference optimization from first principles, addressing memory, TTFT, and throughput issues. It covers foundational concepts like KV cache mathematics and the prefill/decode phases, then dives into model-side optimizations (quantization, attention variants like GQA, FlashAttention) and serving-side techniques (Paged Attention, continuous batching, prefix caching, KV quantization). The session concludes with benchmarks of popular inference engines like vLLM and SGLang, highlighting their strengths for different workloads, and outlines future research directions.

Inside OpenAI’s Breakthroughs in Mathematical Reasoning

Inside OpenAI’s Breakthroughs in Mathematical Reasoning

OpenAI mathematicians discuss how AI, particularly models like Astra and GPT-5, are rapidly advancing mathematical capabilities. They delve into recent breakthroughs in sphere packing and the discovery of a non-sofic group, emphasizing that AI's reasoning traces remarkably resemble expert human thought, including strategic decision-making and backtracking, rather than mere brute-force. The discussion also explores the changing role of human mathematicians, AI's emergent 'taste' in problem-solving, and the potential for a new era of accelerated mathematical discovery and understanding.

How we built Grok Bot in a month | Roman Ugarte (SpaceXAI)

How we built Grok Bot in a month | Roman Ugarte (SpaceXAI)

Roman Ugarte, a key figure behind Grok Bot, shares insights into its rapid development, emphasizing the strategic choice to build it as a separate, cloud-first product with bots having their own dedicated 'computers.' The discussion highlights a "colleague-pilled" product philosophy focused on full delegation and constant reinvention, enabling the creation of autonomous AI teammates for both work and personal life.

Inside the Team That Killed Mandatory Code Review — Quinn Slack, AMP

Inside the Team That Killed Mandatory Code Review — Quinn Slack, AMP

Quinn from AMP discusses a paradigm shift towards cloud-native AI agents and remote development, advocating for the end of local development and traditional code review. He details how AMP's 'Orbs' enable parallel, secure, and remote execution, and how agents are transforming internal tools ('jellyware'), diminishing the role of GitHub and traditional CI/CD, and fostering a lean, high-trust company structure.