Virginia Tech®home

Seminar: Combating Flaky Tests

Darko Marinov

Professor, University of Illinois at Urbana-Champaign

Friday, December 6, 2019
11:15am - 12:15pm
2150 Torgersen Hall



Testing is the most common approach in practice to check software.

Regression testing checks software changes.  A key challenge for regression tests is to detect software bugs and fail when a change introduces a bug, signaling to the developer to fix it.  However, an emerging challenge is that the tests must also _not_ fail when there is _no_ bug in the change.  Unfortunately, some tests, called flaky, can non-deterministically pass or fail on the same software, even when it has no bug.  Such flaky tests give false alarms to developers about the existence of bugs.  A developer may end up wasting time trying to fix bugs not relevant to the recent changes the developer made.  I will present my group's work to alleviate the problem of flaky tests.


Darko Marinov is a Professor in the Department of Computer Science at the University of Illinois  at Urbana-Champaign.  His main research interests are in Software Engineering, especially  software testing.  He has a lot of fun finding and preventing software bugs. He published over 90 conference papers, winning three test-of-time awards--two ACM SIGSOFT Impact Paper Awards (2012, 2019) and one ASE Most Influential Paper Award (2015)--and seven more paper awards--six ACM SIGSOFT Distinguished Paper awards and one CHI Best Paper Award (2017).

His work has been supported by Facebook, Google, Huawei, IBM, Intel, Microsoft, NSF, Qualcomm, and Samsung.  He served as the PC (Co-)Chair for ISSTA 2014, ICST 2015, ASE 2019, and ICSE 2020.  More info is on his web page: