A technical guide on migrating ML experiments from Neptune to Weights & Biases, covering the migration script, API-level code changes, and best practices for organizing projects and analyzing results in the W&B platform before the Neptune sunset.
W&B Models is the system of record for the entire model development lifecycle. This guide explores how to monitor training, tune hyperparameters, track artifacts and lineage for reproducibility, and automate MLOps workflows like evaluation and deployment using a central platform.
An expert overview of post-training techniques for language models, covering the entire workflow from data generation and curation to advanced algorithms like Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and Reinforcement Learning (RL), along with practical advice on evaluation and iteration.
Onshore founder Dominic Vitucci discusses how AI is causing a tectonic shift in the accounting industry, moving from a model based on billable hours to one of technology-driven outcomes, and what this means for the future of the profession and the legacy firms that dominate it.
A detailed breakdown of the updated OWASP Top 10 vulnerabilities for Large Language Models (LLMs), explaining threats like prompt injection, data poisoning, and supply chain risks, along with practical defense strategies.
In this episode, Ben Lorica and Evangelos Simoudis discuss how AI is fundamentally reshaping the modern workplace. They explore the necessary evolution of knowledge work, from a focus on routine execution to problem definition and spec-driven development, and outline the critical skills professionals must cultivate—including rapid experimentation, AI agent orchestration, and systems thinking—to remain valuable and navigate a more volatile labor market.
Ajay Chankramath and Nic Cheneweth discuss the critical elements of effective platform engineering, emphasizing a product mindset, the foundational role of control planes and API-first design, the common pitfalls of implementing Backstage, and the emerging impact of AI and agents on the platform landscape.
Experts Sam Newman, Jacqui Read, and Simon Rohrer explore the nuances of software design, its intersection with architecture, and the critical role of communication in scaling technical clarity. The discussion covers practical advice on implementing Architectural Decision Records (ADRs), the evolving role of the architect as a facilitator, and strategies for creating agile enterprise architectures.
Docker educators Bret Fisher and Elton Stoneman discuss the second edition of Stoneman's book, "Learn Docker in a Month of Lunches". They explore why Docker fundamentals remain crucial in a Kubernetes-dominated world, the evolution of the container ecosystem over the past five years, and the key skills that differentiate a Docker expert from a beginner, such as multi-platform builds, security, and configuration management.
A comprehensive overview of the entire process behind building Olmo 3 Think, covering the full stack from pre-training architecture and data selection to the detailed post-training recipe involving SFT, DPO, and a deep dive into the advanced infrastructure for scaling Reinforcement Learning (RL). The summary also includes critical reflections on the challenges and nuances of evaluating modern reasoning models.
At Applied Compute, efficient Reinforcement Learning is critical for delivering business value. This talk explores the transition from inefficient synchronous RL to a high-throughput asynchronous 'Pipeline RL' system. The core challenge is managing 'staleness'—a side effect of in-flight weight updates that can destabilize training. The speakers detail their first-principles systems model, based on the Roofline model, used to simulate and find the optimal allocation of GPU resources between sampling and training, balancing throughput with algorithmic stability and achieving significant speedups.
A deep dive into the challenges and solutions for efficient Reinforcement Learning (RL) in enterprise settings. The talk contrasts synchronous and asynchronous RL, explains the critical trade-off of "staleness" versus stability, and details a first-principles system model used to optimize GPU allocation for maximum throughput.
![Tensor Logic "Unifies" AI Paradigms [Pedro Domingos]](https://img.youtube.com/vi/4APMGvicmxY/maxresdefault.jpg)
Pedro Domingos introduces Tensor Logic, a new programming language designed to be the fundamental language for AI. It unifies the two major paradigms: the learning capabilities of deep learning (neural networks) and the transparent, verifiable reasoning of symbolic AI (logic programming), aiming to solve critical issues like hallucination and the opacity of current models.
Pedro Domingos introduces Tensor Logic, a new programming language designed to be the fundamental language for AI. It unifies the two major paradigms: the data-driven learning of deep learning and the verifiable reasoning of symbolic AI. By treating logical rules and tensor operations as the same underlying construct, Tensor Logic enables systems that can learn logical structures and perform transparent, deductive reasoning, directly addressing critical issues like model opacity and hallucination.
Pedro Domingos introduces Tensor Logic, a new programming language designed to unify the two major paradigms of AI—deep learning's ability to learn from data and symbolic AI's power of logical reasoning—into a single, elegant framework.
Get updates straight to your inbox. No spam, just useful content.