JuliaCon 2023

PerfChecker.jl: tools for performance checking over versions
07-26, 10:05–10:35 (US/Eastern), Online talks and posters

PerfChecker.jl is an early version of a set of tools I made to check the performance of the packages in JuliaConstraints over time and versions.

The user provides a set of instructions to run in the same vein as Test.jl that can be used for allocation checks and benchmarks. Finally, the results are plotted in function of the versions.

An example of the pipeline is available at https://github.com/JuliaConstraints/PerfChecker.jl

This poster presents an early version of PerfChecker.jl, a set of tools made to check the performance of packages over time and versions. Although the general workflow of this package is designed, we expect several changes to take place before a stable release.

Currently, we invite the users to use it as follows:

  • Prepare a set of instructions to be evaluated for package P
  • Separate instructions for allocations and benchmarks are possible
  • For each versions of P to be checked do
  • Checkout the targeted version of P
  • Load PerfChecker and P
  • Execute the checks
  • Leave the current Julia session (if in REPL)
  • Launch a new REPL and compile the checks of all the different versions

An example of this workflow is given on the README at https://github.com/JuliaConstraints/PerfChecker.jl

The final goal of PerfChecker.jl is to have a behavior similar to Test.jl. Contributions are more than welcome.

Researcher at Internet Initiative Japan (IIJ) research lab, specialized in Optimization, Networks, Data Structures, and Algorithms.

This speaker also appears in: