Better Testing Through Statistics
Presented by
Matthew Treinish
Tuesday
4:35 p.m.–5:20 p.m.
Target audience:
Developer
Abstract
The OpenStack Gate operates at a tremendous scale, with on average roughly 12 thousand test jobs launched every day. It's exciting to see testing happen at such a large scale. However there is an issue, it is too difficult for humans to deal with all the data being generated or analyze all the results from the testing. To deal with this the OpenStack community has developed and deployed several tools to help deal with the torrent of data. Using and building off these tools have been invaluable especially as the OpenStack project continues to grow. This talk will explain the basics of OpenStack's CI infra and cover the approach and tooling used by the OpenStack community to interact with the large amount of test result. It will explain the techniques used and the benefits derived from having both open test result data and performing analysis on that data to understand the project.
Presented by
Matthew Treinish
Matthew is currently a member of the OpenStack TC (Technical Committee) and was previously the PTL (project technical lead) of the OpenStack community's QA program from OpenStack's Juno development cycle in 2014 through the Mitaka development cycle in 2016. He is a core contributor on several Openstack projects and a core member of the OpenStack stable maintenance team. He has been working on and contributing to Open Source software for most of his career and has been primarily contributing to OpenStack since 2012. Matthew currently works for IBM on Upstream OpenStack development, working to make OpenStack better for everyone. Matthew has previously been a speaker at OpenStack summits, LinuxCons Japan and North America, FOSSASIA, PyConAU's OpenStack miniconf, and linux.conf.au's CI and Testing miniconf.