Human computer interaction

The Prompt Is Still a Punch Card - Ted Johnson, JoinIn AI

The Prompt Is Still a Punch Card - Ted Johnson, JoinIn AI

Ted Johnson argues that current AI interfaces, particularly prompting, operate on an outdated "batch processing" protocol akin to punch cards. Despite advanced LLM capabilities, this interface design forces humans to adapt to machines, hindering natural interaction. He advocates for a shift towards human-compatible interfaces where AI actively participates in real-time conversation, leveraging its intelligence to remove user burdens and amplify human potential.

Voice In, Visuals Out: The Agony and the Ecstasy - Allen Pike, Forestwalk Labs

Voice In, Visuals Out: The Agony and the Ecstasy - Allen Pike, Forestwalk Labs

Allen Pike (Forestwalk Labs) discusses the power of "voice-in, visuals-out" AI experiences, a paradigm championed by Andrej Karpathy. He highlights the critical challenge of latency in real-time AI interactions and shares three key techniques for achieving low-latency, delightful user experiences: utilizing fast models, employing short inference intervals, and implementing stable caching regimens.

The Evolution of User Interfaces • Ken Pfeuffer • GOTO 2025

The Evolution of User Interfaces • Ken Pfeuffer • GOTO 2025

Ken Pfeuffer discusses the evolution of user interfaces, from traditional hand-centric inputs to the emerging paradigm of eye-hand symbiosis. He traces the history of gaze interaction research, explains his decade-long work on "gaze and pinch," and shares how these concepts are now becoming reality with devices like Apple Vision Pro, outlining future directions for intuitive spatial computing.

Computer use in Codex

Computer use in Codex

Ari Weinstein discusses how Codex's 'computer use' feature allows the AI agent to operate local Mac applications in the background by combining multimodal vision with accessibility data, enabling non-intrusive, parallel task execution.

From Chat Fatigue to Instant Action // Donné Stevenson

From Chat Fatigue to Instant Action // Donné Stevenson

A discussion on the evolution of AI agent interaction, moving beyond simple text-based chat to create intuitive, GUI-driven experiences. The talk covers the practical challenges and solutions in building an impactful agent for busy professionals, focusing on quick actions, efficient data streaming, and enhanced interactivity.

When Agents Learn to Feel: Multi-Modal Affective Computing in Production // Chenyu Zhang

When Agents Learn to Feel: Multi-Modal Affective Computing in Production // Chenyu Zhang

This talk explores the frontier of affective computing in AI agents, proposing a new architecture where emotion is a first-class component. It covers the technical challenges of deploying multi-modal, emotion-aware systems in production—from memory and learning to multi-agent orchestration—and delves into the critical ethical considerations of privacy, manipulation, and scientific validity.