Context windows

Is Fine-Tuning Still Needed? LLMs, RAG, & LoRA

Is Fine-Tuning Still Needed? LLMs, RAG, & LoRA

This summary explores the evolving role of fine-tuning in modern AI workflows, comparing it with advanced techniques like RAG, LoRA, and enhanced generative AI capabilities. It discusses the historical benefits, current limitations due to rapidly advancing frontier models, and outlines a practical decision framework for customizing machine learning models and designing efficient AI systems.

The Great Loops Debate — Dex Horthy, Geoff Huntley, Ian Livingstone, Greg Pstrucha, @insecure-agents

The Great Loops Debate — Dex Horthy, Geoff Huntley, Ian Livingstone, Greg Pstrucha, @insecure-agents

An Oxford-style debate exploring the gap between the hype and practical reality of "loops" in AI/ML development. Experts discuss their history, optimal anatomy, future role in software factories, and challenges like security, economic viability, and the imperative for strong engineering discipline.

5 More AI Myths & The Truth Behind Them: ML, Context, Agents & More

5 More AI Myths & The Truth Behind Them: ML, Context, Agents & More

Martin Keen debunks five common AI myths, covering topics from reduced AI hallucinations and the misinterpretation of AI's "thinking" process, to the rising costs of AI inference, the limitations of large context windows, and the current challenges to fully autonomous AI agents.