20-24 September 2021
US/Pacific timezone

Analyzing historical DejaGNU test result data with the Bunsen toolkit

20 Sep 2021, 08:30
30m
GNU Tools track/Virtual-Room (LPC Virtual)

GNU Tools track/Virtual-Room

LPC Virtual

150
GNU Tools Track GNU Tools Track

Speaker

Serguei Makarov (Red Hat Inc.)

Description

Bunsen is a toolkit for compact storage and analysis of DejaGNU test results. The toolkit includes a storage engine that compresses and indexes a large collection of test result logs in a Git repository, a Python library for querying and analyzing the test result collection, and a simple CGI service for accessing query results through a web browser.

In this talk I will give an in-depth look at how Bunsen can be used to understand the current state of a project's testsuite. Based on my experience using Bunsen to collect and monitor test results from the SystemTap project, I will show how keeping a long-term repository of test results enables more sophisticated and useful analysis. In particular, I will show how Bunsen analysis scripts can help to locate significant regressions and filter out insignificant ones, identify nondeterministic ('flaky') testcases, and narrow down the commits that introduced a particular regression.

Type: prepared presentation (~25min)

I agree to abide by the anti-harassment policy I agree

Primary author

Serguei Makarov (Red Hat Inc.)

Presentation Materials

There are no materials yet.