TY - GEN
T1 - An Empirical Study of Regression Testing for Android Apps in Continuous Integration Environment
AU - Wang, Dingbang
AU - Zhao, Yu
AU - Xiao, Lu
AU - Yu, Tingting
N1 - Publisher Copyright:
© 2023 IEEE.
PY - 2023
Y1 - 2023
N2 - Continuous integration (CI) has become a popular method for automating code changes, testing, and software project delivery. However, sufficient testing prior to code submission is crucial to prevent build breaks. Additionally, testing must provide developers with quick feedback on code changes, which requires fast testing times. While regression test selection (RTS) has been studied to improve the cost-effectiveness of regression testing for lower-level tests (i.e., unit tests), it has not been applied to the testing of user interfaces (UI) in application domains such as mobile apps. UI testing at the UI level requires different techniques such as impact analysis and automated test execution. In this paper, we examine the use of RTS in CI settings for UI testing across various open-source mobile apps. Our analysis focuses on using Frequency Analysis to understand the need for RTS, Cost Analysis to evaluate the cost of impact analysis and test case selection algorithms, and Test Reuse Analysis to determine the reusability of UI test sequences for automation. The insights from this study will guide practitioners and researchers in developing advanced RTS techniques that can be adapted to CI environments for mobile apps.
AB - Continuous integration (CI) has become a popular method for automating code changes, testing, and software project delivery. However, sufficient testing prior to code submission is crucial to prevent build breaks. Additionally, testing must provide developers with quick feedback on code changes, which requires fast testing times. While regression test selection (RTS) has been studied to improve the cost-effectiveness of regression testing for lower-level tests (i.e., unit tests), it has not been applied to the testing of user interfaces (UI) in application domains such as mobile apps. UI testing at the UI level requires different techniques such as impact analysis and automated test execution. In this paper, we examine the use of RTS in CI settings for UI testing across various open-source mobile apps. Our analysis focuses on using Frequency Analysis to understand the need for RTS, Cost Analysis to evaluate the cost of impact analysis and test case selection algorithms, and Test Reuse Analysis to determine the reusability of UI test sequences for automation. The insights from this study will guide practitioners and researchers in developing advanced RTS techniques that can be adapted to CI environments for mobile apps.
KW - Android apps
KW - Empirical study
KW - Regression testing
UR - http://www.scopus.com/inward/record.url?scp=85178653855&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85178653855&partnerID=8YFLogxK
U2 - 10.1109/ESEM56168.2023.10304799
DO - 10.1109/ESEM56168.2023.10304799
M3 - Conference contribution
AN - SCOPUS:85178653855
T3 - International Symposium on Empirical Software Engineering and Measurement
BT - 2023 ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2023
T2 - 17th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2023
Y2 - 26 October 2023 through 27 October 2023
ER -