Build with Perception Agents
Official Schedule Context
- Date/time: 2026-06-29 · 2:20pm-4:20pm
- Track/room: Workshops Day 1 · Track 8
- Speaker(s): Emile Baizel, Shruti Arora
- Session type/status: session · confirmed
Official Description
Human-agent collaboration is changing, becoming more visual. Models can perceive, point, and verify,
but most agents still rely on us typing a paragraph to explain what we're looking at. Meet
perception agents: computer use agents that see screens how you see screens. They understand,
reason, and verify their own work. They let you point, draw, and describe, just as people
collaborate in real life. We call this shared perception, and at AGI Lab we just open-sourced the
first two primitives of our perception agent harness: visual verification and visual annotation. In
this workshop, you'll get hands-on with both, build one sample use case end-to-end, then take the
primitives back to your day-to-day in a mini hackathon. Best ideas win prizes.
Related YouTube Video
No related AI Engineer channel video found yet.
Transcript Status
No official session recording transcript was found by exact title match on the AI Engineer YouTube channel during this run.
People
Notes
- Pending transcript synthesis when an official recording or confirmed matching video is available.