Anna Pillar
Anna Pillar is a data scientist at Sogeti. With a foundation in both Cognitive Science and AI, she combines technical knowledge of AI with insights from theory of mind and social cognition. Day to day, she puts this into practice building LLM-powered solutions, including agentic workflows.
Outside of work, she is an avid reader, board game enthusiast and proud owner of a sourdough starter.
Session
Multi-agent LLM systems typically fall into one of two patterns: agents take fixed turns, or a single orchestrator decides who speaks next. Both are easy to implement, but both sacrifice agent autonomy. As agents become increasingly capable and specialized, productive and optimized communication between them will be crucial to unlocking their full potential. A key part of this is deciding when it is time for an agent to speak. In this talk, we will discuss whether agents can negotiate their own speaking order, and how we might evaluate their results.
We will use a Scrum refinement meeting as our multi-agent playground. A team of role-based agents, representing classic roles from a Scrum team, must collaboratively turn a business request into a backlog of implementable user stories. We implement and compare different turn-taking strategies and evaluate these using LLM-as-a-judge across metrics including participation balance, unanswered questions, redundancy, topic drift, and urgency realism.
Attendees will learn about multi-agent communication patterns, concrete turn-taking strategies they can put into practice, comparative evaluation results, a reusable evaluation strategy, and a public repository with code and notebooks they can adapt to their own multi-agent experiments.