988: In Case You Missed It in April 2026 — with @JonKrohnLearns
This episode explores the foundations of AI agent memory, drawing parallels with human neuroscience. It also covers the practical impact of AI on data engineering roles, the democratization of AI development through low-code tools, and innovative applications of AI in elementary education to foster critical thinking.
Drawing inspiration from biology and neuroscience to advance technology is a well-established practice, from the Wright brothers studying birds to the development of Convolutional Neural Networks (CNNs) inspired by Hubel and Wiesel’s experiments on the visual cortex of cats. This principle is now being applied to the architecture of AI agents, particularly in the domain of memory.
The Four Types of Memory for AI Agents
Just as animal memory is categorized, agent memory can be broken down into four essential types, each with a distinct function and implementation.
-
Episodic Memory: This relates to memories associated with a specific time or event. In an agent, this is most clearly represented by conversation history. Each turn in a dialogue (user and assistant message) is stored with a timestamp, creating a discrete “episode” that the agent can recall to maintain context.
-
Procedural Memory: This is the “how-to” knowledge—skills, routines, and workflows. For AI agents, this is implemented through
skills.mdfiles, which act as Standard Operating Procedures (SOPs). Instead of loading all skills into the context at once, a more scalable approach involves storing these skills in a database, perhaps as vector representations. This allows the agent to retrieve only the relevant skills at the appropriate time, optimizing performance. -
Semantic Memory: This encompasses general world knowledge, facts, and concepts, akin to information in an encyclopedia. For an enterprise agent, this is the institutional knowledge base—the data, terminology, and processes specific to the organization—that allows it to function with the same understanding as an employee.
-
Working Memory: This is the short-term memory used for real-time processing and interaction. In the context of Large Language Models (LLMs), the working memory is directly analogous to the context window, which holds the information immediately available to the model for generating a response.
The Impact of AI Agents on Engineering and Careers
AI is not just a theoretical concept; it’s actively reshaping technical roles and career trajectories.
-
Augmentation Over Replacement: AI agents are positioned to augment, not replace, experienced data engineers. They act as a force multiplier, giving a single engineer “10x” more capability. This allows them to move away from tedious tasks and focus on higher-level strategic work.
-
The Junior-Level Hiring Challenge: The primary impact on the job market will likely be a reduction in hiring for junior-level roles. As senior staff become vastly more productive, the need to hire entry-level talent decreases. This creates a “double whammy” for new graduates, as companies will seek individuals already skilled in orchestrating AI, while the education system is still struggling to integrate AI into its curriculum.
-
The Rise of the AI Orchestrator: A new critical skill is emerging: the ability to manage and conduct multiple AI agents in parallel, a concept described as “spinning plates.” Individuals who excel at this kind of context-switching and systems thinking will become highly valuable.
Democratization, Infrastructure, and Transferable Skills
The barrier to entry in AI development is rapidly lowering, leading to a shift in focus from coding to systems thinking and domain expertise.
-
From Code to “Vibe Coding”: With natural language prompts, it’s now possible to build, train, and deploy AI applications without writing traditional code. However, as these applications scale, AI infrastructure (
AI infra) challenges become the primary bottleneck. Non-technical founders are now encountering classic systems problems, describing issues like “lagging” or “context is not working,” which are fundamentally infrastructure concerns. -
The Value of Non-Linear Careers: Domain expertise is becoming more valuable than ever. An individual with a background in a specific industry (e.g., media, real estate) has a significant advantage because they deeply understand the user’s needs and pain points. This “transferable skill” provides the context and confidence that a pure technologist might lack. An engineer’s strength lies in understanding where systems fail, making a collaboration between domain experts and engineers a powerful combination.
AI as a Tool for Critical Thinking in Education
AI is being implemented in classrooms not as a shortcut, but as a tool to deepen critical thinking and personalize learning. At the Elliot Innovation School in Boston, students from fifth to eighth grade use AI to enhance their analytical skills.
-
Student vs. AI for Metacognition: In one exercise, a student writes an essay, then prompts an AI to write an essay on the same topic. The student’s task is to critically compare the two responses and justify which one is better and why. This process forces them to engage in metacognition—thinking about their own thinking and writing process.
-
Personalized Learning and Error Analysis: When students get a multiple-choice question wrong, they use AI to understand the reasoning behind the correct answer and, more importantly, to analyze the “almost right answer.” This helps them identify patterns in their mistakes, which are tracked to provide feedback to the teacher. This approach follows the philosophy:
AI raises the floor. Teachers are raising the ceiling.
The foundation for this successful implementation is a strong emphasis on AI literacy for both students and educators, ensuring they are critical and ethical consumers of the technology from a young age.