KVM Forum 2024

Automated hypervisor testing and benchmarking on hardware
2024-09-22 , Hall A+B

Automated testing is a very important tool in modern software engineering, and is often implemented through runners in virtualized environments. Low-level domains, such as kernel development, have unique requirements that are not covered in these environments, but automation of all different kinds of hardware comes with additional challenges. In this talk, we will deep-dive into some of the challenges we encountered during development and use of SoTest, a custom-made service for automatically testing and benchmarking virtualization workloads on a broad variety of hardware, including:

  • How can we make arbitrary hardware remote-controllable?

  • How do we integrate these tests into the developer workflow?

  • How can we optimize the throughput?

  • How do we enable performance benchmarking?

  • How do we handle, e.g., network infrastructure flakiness?

See also: Slides (1.8 MB)

Markus Napierkowski is Technical Lead at Cyberus Technology GmbH, where he contributed to different low-level virtualization projects, helped build an internal hardware test automation service, and is currently responsible for the overall software engineering methodology.

Software Engineer at Cyberus Technology