Open Source Conference Luxembourg

Alessio Buscemi

Alessio Buscemi is a Senior Scientist at the Luxembourg Institute of Science and Technology. His work focuses on the assessment and governance of AI systems.


Sessions

10-07
10:40
20min
Assessing AI trustworthiness at scale
Alessio Buscemi

Any organisation putting AI into production ends up assessing it, whether for its own self-assessment, for conformity, or inside a regulatory sandbox. Assessment has two halves: technical tests that measure the system, and controls, compliance checklists whose questions map to specific EU AI Act provisions and return a readiness judgement rather than a metric. The AI Assessment Sandbox Configurator, developed open-source by LIST and the University of Luxembourg within the Luxembourg AI Factory, treats both as first-class catalogue entries behind one open plug-in API: qualify your AI system, select the tests and controls that fit it, and generate a sandbox à la carte that executes and reports on both, on your own infrastructure.

Topic: Public Sector and international institutions
Auditorium
10-07
11:30
90min
Hands-on Workshop: Building an AI Assessment Sandbox
Alessio Buscemi

Any organisation putting AI into production eventually needs to assess it, whether for internal self-assessment, conformity assessment, or participation in a regulatory sandbox. In this hands-on workshop, participants will learn how to build and configure an AI assessment sandbox that combines technical testing with EU AI Act compliance controls.

The workshop introduces the AI Assessment Sandbox Configurator, an open-source solution developed by LIST and the University of Luxembourg within the Luxembourg AI Factory. The platform treats technical tests and compliance controls as first-class catalogue entries behind a single, open plug-in API.

Participants will work directly with the configurator to:

  • Qualify an AI system and identify the types of assessment it requires.
  • Select and configure technical tests to measure properties such as robustness, security, bias, or accuracy.
  • Select compliance controls whose questions map to specific provisions of the EU AI Act and produce a readiness judgement rather than a numerical metric.
  • Compose a tailored assessment sandbox by combining the tests and controls relevant to the system.
  • Run the assessment on their own infrastructure and inspect the resulting reports.

By the end of the workshop, participants will have built and executed an à-la-carte AI assessment sandbox, gaining practical experience in connecting technical evaluation with regulatory and governance requirements.

Topic: Artificial Intelligence
Artificial Intelligence