Metrics
5 Record Views
Journal article
Root causing, detecting, and fixing flaky tests: State of the art and future roadmap
Software, practice & experience, Vol.51(5), pp.851-867
05/2021
Web of Science ID: WOS:000584400400001
Abstract
A flaky test is a test that may lead to different results in different runs on a single code under test without any change in the test code. Test flakiness is a noxious phenomenon that slows down software deployment, and increases the expenditures in a broad spectrum of platforms such as software-defined networks and Internet of Things environments. Industrial institutes and labs have conducted a whole lot of research projects aiming at tackling this problem. Although this issue has been receiving more attention from academia in recent years, the academic research community is still behind the industry in this area. A systematic review and trend analysis on the existing approaches for detecting and root causing flaky tests can pave the way for future research on this topic. This can help academia keep pace with industrial advancements and even lead the research in this field. This article first presents a comprehensive review of recent achievements of the industry as well as academia regarding the detection and mitigation of flaky tests. In the next step, recent trends in this line of research are analyzed and a roadmap is established for future research.
Related links
Details
- Title
- Root causing, detecting, and fixing flaky tests
- Publication Details
- Software, practice & experience, Vol.51(5), pp.851-867
- Resource Type
- Journal article
- Publisher
- Wiley
- Number of pages
- 17
- Copyright
- © 2020 John Wiley & Sons, Ltd.
- Identifiers
- WOS:000584400400001; 99381506994406600
- Academic Unit
- Cybersecurity and Information Technology; Hal Marcus College of Science and Engineering
- Language
- English