988: In Case You Missed It in April 2026 — with @JonKrohnLearns

This episode explores the foundations of AI agent memory, drawing parallels with human neuroscience. It also covers the practical impact of AI on data engineering roles, the democratization of AI development through low-code tools, and innovative applications of AI in elementary education to foster critical thinking.

4 min read
988: In Case You Missed It in April 2026 — with @JonKrohnLearns
source: https://www.youtube.com/watch?v=jDw-5E4O7FA

Drawing inspiration from biology and neuroscience to advance technology is a well-established practice, from the Wright brothers studying birds to the development of Convolutional Neural Networks (CNNs) inspired by Hubel and Wiesel’s experiments on the visual cortex of cats. This principle is now being applied to the architecture of AI agents, particularly in the domain of memory.

The Four Types of Memory for AI Agents

Just as animal memory is categorized, agent memory can be broken down into four essential types, each with a distinct function and implementation.

  • Episodic Memory: This relates to memories associated with a specific time or event. In an agent, this is most clearly represented by conversation history. Each turn in a dialogue (user and assistant message) is stored with a timestamp, creating a discrete “episode” that the agent can recall to maintain context.

  • Procedural Memory: This is the “how-to” knowledge—skills, routines, and workflows. For AI agents, this is implemented through skills.md files, which act as Standard Operating Procedures (SOPs). Instead of loading all skills into the context at once, a more scalable approach involves storing these skills in a database, perhaps as vector representations. This allows the agent to retrieve only the relevant skills at the appropriate time, optimizing performance.

  • Semantic Memory: This encompasses general world knowledge, facts, and concepts, akin to information in an encyclopedia. For an enterprise agent, this is the institutional knowledge base—the data, terminology, and processes specific to the organization—that allows it to function with the same understanding as an employee.

  • Working Memory: This is the short-term memory used for real-time processing and interaction. In the context of Large Language Models (LLMs), the working memory is directly analogous to the context window, which holds the information immediately available to the model for generating a response.

The Impact of AI Agents on Engineering and Careers

AI is not just a theoretical concept; it’s actively reshaping technical roles and career trajectories.

  • Augmentation Over Replacement: AI agents are positioned to augment, not replace, experienced data engineers. They act as a force multiplier, giving a single engineer “10x” more capability. This allows them to move away from tedious tasks and focus on higher-level strategic work.

  • The Junior-Level Hiring Challenge: The primary impact on the job market will likely be a reduction in hiring for junior-level roles. As senior staff become vastly more productive, the need to hire entry-level talent decreases. This creates a “double whammy” for new graduates, as companies will seek individuals already skilled in orchestrating AI, while the education system is still struggling to integrate AI into its curriculum.

  • The Rise of the AI Orchestrator: A new critical skill is emerging: the ability to manage and conduct multiple AI agents in parallel, a concept described as “spinning plates.” Individuals who excel at this kind of context-switching and systems thinking will become highly valuable.

Democratization, Infrastructure, and Transferable Skills

The barrier to entry in AI development is rapidly lowering, leading to a shift in focus from coding to systems thinking and domain expertise.

  • From Code to “Vibe Coding”: With natural language prompts, it’s now possible to build, train, and deploy AI applications without writing traditional code. However, as these applications scale, AI infrastructure (AI infra) challenges become the primary bottleneck. Non-technical founders are now encountering classic systems problems, describing issues like “lagging” or “context is not working,” which are fundamentally infrastructure concerns.

  • The Value of Non-Linear Careers: Domain expertise is becoming more valuable than ever. An individual with a background in a specific industry (e.g., media, real estate) has a significant advantage because they deeply understand the user’s needs and pain points. This “transferable skill” provides the context and confidence that a pure technologist might lack. An engineer’s strength lies in understanding where systems fail, making a collaboration between domain experts and engineers a powerful combination.

AI as a Tool for Critical Thinking in Education

AI is being implemented in classrooms not as a shortcut, but as a tool to deepen critical thinking and personalize learning. At the Elliot Innovation School in Boston, students from fifth to eighth grade use AI to enhance their analytical skills.

  • Student vs. AI for Metacognition: In one exercise, a student writes an essay, then prompts an AI to write an essay on the same topic. The student’s task is to critically compare the two responses and justify which one is better and why. This process forces them to engage in metacognition—thinking about their own thinking and writing process.

  • Personalized Learning and Error Analysis: When students get a multiple-choice question wrong, they use AI to understand the reasoning behind the correct answer and, more importantly, to analyze the “almost right answer.” This helps them identify patterns in their mistakes, which are tracked to provide feedback to the teacher. This approach follows the philosophy:

AI raises the floor. Teachers are raising the ceiling.

The foundation for this successful implementation is a strong emphasis on AI literacy for both students and educators, ensuring they are critical and ethical consumers of the technology from a young age.

Share post

Stay In The Loop! Subscribe to Our Newsletter.

Get updates straight to your inbox. No spam, just useful content.

Recommended for You

"We're Not Writing Code by Hand Anymore. That's Over." | Owen Jennings & David Haber - The a16z Show

"We're Not Writing Code by Hand Anymore. That's Over." | Owen Jennings & David Haber - The a16z Show

Owen Jennings, Executive Officer at Block, details the company's radical restructuring (40% workforce reduction) driven by AI's impact on productivity. He explains how Block is now operating with smaller squads, leveraging internal AI tools like Goose and Builder Bot, and shipping AI-native products like Money Bot and Manager Bot to deliver personalized, generative UIs for millions of users, emphasizing a future where unique understanding forms the ultimate business moat.

This AI Company Catches Fraud Across the Internet

This AI Company Catches Fraud Across the Internet

Variance, emerging from three years in stealth with a $21 million Series A, is transforming enterprise risk and compliance through purpose-built AI agents. Founded by ex-Apple engineers, the company automates complex tasks like fraud detection, content review, and identity verification for Fortune 500s and platforms such as GoFundMe. They discuss the strategic reasons for stealth, technical challenges of integrating disparate data sources (including UI scraping), the shift from legacy systems to self-healing AI agent architectures, and how their lean, AI-maximalist team detects sophisticated threats like state-sponsored fraud rings.