RoboCon 2024

Beyond log files: Elevating test analysis with data visualization
2024-02-28 , RoboConOnline

Discover the limitations of raw data and learn why visualizations are essential for making informed decisions. Harness the art of visualization to decode data intricacies.


The Robot Framework output files give a good overview of the latest run. For short term analysis, that is sufficient, but you will not know if passes, failures, execution times, etc. are consistent, unexpected, or following a certain trend. Therefore, data visualization is the key to unlock the potential of all the collected data and deep data analysis. They help your team react to issues faster and in some cases they even help you understand possible issues even before they become actual issues enabling proactive actions.

This presentation will explore some real life examples from telecom and embedded systems industries where data visualization helped organizations evaluate their systems from a different perspective, so they could identify and justify necessary actions to help them get back on track. The talk will expand the knowledge of available data and give tips on how to harness that data into use to reveal your unknown issues, gain confidence in your systems, and improve your testing overall.


In-Person or Online talk?:

In-person

Lessons Learned:

Listeners will learn the possibilities of digging up data from the output.xml themselves and learn about different tools for data storage (different databases, e.g InfluxDB), visualizations (mainly Grafana), and give possible new ideas on what they can start visualising in their own projects.

Describe your intended audience:

Target audience is everyone who works with Robot Framework and hopefully in a CI/CD environment. The talk won't be very technical, but the actual practices will be for more technical oriented people (the ones who actually do the data collection).

Is this suitable for ..?:

Beginner RF user, Intermediate RF user, Advanced RF user

Senior DevOps consultant at Eficode. He is an active Robot Framework community member, Robot Framework trainer, and the current maintainer of the Robot Framework Jenkins plugin.