Open Source Conference Luxembourg

Hands-on Workshop: Building an AI Assessment Sandbox

Any organisation putting AI into production eventually needs to assess it, whether for internal self-assessment, conformity assessment, or participation in a regulatory sandbox. In this hands-on workshop, participants will learn how to build and configure an AI assessment sandbox that combines technical testing with EU AI Act compliance controls.

The workshop introduces the AI Assessment Sandbox Configurator, an open-source solution developed by LIST and the University of Luxembourg within the Luxembourg AI Factory. The platform treats technical tests and compliance controls as first-class catalogue entries behind a single, open plug-in API.

Participants will work directly with the configurator to:

  • Qualify an AI system and identify the types of assessment it requires.
  • Select and configure technical tests to measure properties such as robustness, security, bias, or accuracy.
  • Select compliance controls whose questions map to specific provisions of the EU AI Act and produce a readiness judgement rather than a numerical metric.
  • Compose a tailored assessment sandbox by combining the tests and controls relevant to the system.
  • Run the assessment on their own infrastructure and inspect the resulting reports.

By the end of the workshop, participants will have built and executed an à-la-carte AI assessment sandbox, gaining practical experience in connecting technical evaluation with regulatory and governance requirements.

Alessio Buscemi

Alessio Buscemi is a Senior Scientist at the Luxembourg Institute of Science and Technology. His work focuses on the assessment and governance of AI systems.