Marysia Winkels
Marysia Winkels is an AI Security Researcher at Gray Swan, and previously worked at Cohere and Xebia Data. She also happily organised, participated, attended and volunteered at previous editions of PyData Amsterdam.
Session
Have you ever given an AI agent access to your codebase, your inbox, or your files? The model is from a top lab, the system prompt or rules file says what it can and can't do. Do you... trust it? Or does it make you feel just a little bit uneasy?
If so, you'd be right.
In this talk, we'll look at how AI agents fail: in everyday use, and under deliberate attack. We'll explore why the safety layers most of us rely on are probabilistic rather than guaranteed, what happens when someone exploits that, and what lessons we can draw from security engineering. You'll leave with a better understanding of where agents are vulnerable, and concrete steps you can take to deploy them more safely.