An exploration of the evolving AI landscape, covering the paradigm shift in cybersecurity due to AI agents, the practicalities of running local LLMs with tools like Ollama and vLLM, and the emerging stack for agent-to-agent communication.
Distinguished Engineer Chris Hay demonstrates how to run and program Large Language Models (LLMs) locally in just two lines of Python code. The tutorial covers setting up a local environment with Ollama and UV, using a custom library for simplified interaction, and explores advanced topics like asynchronous streaming, persona customization with system prompts, and managing multi-turn conversations.