2025-07-23 –, Main Room 4
To optimize code, we must have good tools for measuring performance. Chairmarks.jl measures performance substantially faster than BenchmarkTools.jl while gathering more data at a similar accuracy. By avoiding eval and repeated gc calls and an efficient tuning algorithm, Charimarks achieves efficiecies of up to 99%, making setup and tuning time negligible. This allows for a more straightforward API and a much snappier user experience (from 5 seconds to 100ms).
Chairmarks.jl prioritizes the experience of users writing and running benchmarks interactively and also provides a highly extensible interface for working with CI and batch jobs. This talk will:
- Explain and showcase Chairmarks' novel implicit pipeline syntax which allows interactive users to specify initialization, setup, primary function, and teardown or any subset of those without any boilerplate syntax;
- Demonstrate the accuracy, scalability, and ease of use;
- Delineate the execution model;
- Describe the auto-tuning algorithm; and
- Exhibit the use of Chairmarks.jl with AirspeedVelocity.jl to automatically report performance changes in CI.
Artist, Scientist, Open source developer.