PathQuarry: Watching RL Agents Discover Privilege Escalation
Your cloud environment has privilege escalation paths you haven't found yet. Static tools dump tables of misconfigurations, but they don't show you how those misconfigurations chain together into full attack paths or which ones an attacker would actually find first. Security teams need to see the shape of their exposure, rather than searching through spreadsheets of individual findings stitched together by guesswork.
PathQuarry is a visualization engine that lets you watch a reinforcement learning agent explore your cloud attack surface in real time. The entire tool is open source and extends to Azure and GCP. Feed it an AWS environment, and a Datalog engine derives what's reachable like IAM misconfigurations, overpermissioned roles, cross-service trust relationships, and resource-level policy gaps, while a Q-learning agent discovers and ranks multi-step escalation chains live on screen, rendered as an interactive force-directed graph. Nodes light up as the agent visits them. Edges thicken as paths get reinforced. Dead ends fade out. You can pause, rewind, step through the agent's decisions at each state, and see exactly why it chose one path over another.
I will demo PathQuarry against AWSGoat and CloudGoat, two deliberately vulnerable AWS environments, showing how the visual approach surfaces non-obvious attack chains: lateral movements through Lambda execution roles, cross-account pivots via confused deputy patterns, and credential chaining through instance metadata that get buried in text-based output. I will also show how the agent's learned Q-values provide a natural risk ranking: the paths it converges on fastest are the ones a real attacker would discover first. By visually proving this convergence, we give an opportunity for defenders to prioritize remediation in a principled way.
Maria is a security researcher and PhD student at Dartmouth College (currently visiting EPFL) focused on ML application security and graph theory. At the moment, she is interested in researching attack graphs and symbolic systems security. She is also interested in machine learning security, specifically data poisoning. In her free time she researches applying graph theory and network science to cybersecurity. Her first work focused on visualizing data poisoning and tampering using networks. Maria’s blog can be found at vesna.my
