skip to main content
10.1145/3533767.3543293acmconferencesArticle/Chapter ViewAbstractPublication PagesisstaConference Proceedingsconference-collections
short-paper
Open Access
Artifacts Available / v1.1

ATUA: an update-driven app testing tool

Published:18 July 2022Publication History

ABSTRACT

App testing tools tend to generate thousand test inputs; they help engineers identify crashing conditions but not functional failures. Indeed, detecting functional failures requires the visual inspection of App outputs, which is infeasible for thousands of inputs. Existing App testing tools ignore that most of the Apps are frequently updated and engineers are mainly interested in testing the updated functionalities; indeed, automated regression test cases can be used otherwise. We present ATUA, an open source tool targeting Android Apps. It achieves high coverage of the updated App code with a small number of test inputs, thus alleviating the test oracle problem (less outputs to inspect). It implements a model-based approach that synthesizes App models with static analysis, integrates a dynamically-refined state abstraction function and combines complementary testing strategies, including (1) coverage of the model structure, (2) coverage of the App code, (3) random exploration, and (4) coverage of dependencies identified through information retrieval. Our empirical evaluation, conducted with nine popular Android Apps (72 versions), has shown that ATUA, compared to state-of-the-art approaches, achieves higher code coverage while producing fewer outputs to be manually inspected. A demo video is available at https://youtu.be/RqQ1z_Nkaqo.

References

  1. Android. 2022. Monkey. http://developer.android.com/tools/help/monkey.html Google ScholarGoogle Scholar
  2. Nataniel P. Borges Jr., Jenny Hotzkow, and Andreas Zeller. 2018. DroidMate-2: A Platform for Android Test Generation. In ASE 2018. ACM, New York, NY, USA. 916–919. isbn:978-1-4503-5937-5 https://doi.org/10.1145/3238147.3240479 Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Wontae Choi, Koushik Sen, George Necula, and Wenyu Wang. 2018. DetReduce: Minimizing Android GUI Test Suites for Regression Testing. In ICSE 2018. ACM, New York, NY, USA. 445–455. isbn:9781450356381 https://doi.org/10.1145/3180155.3180173 Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Daniel Domínguez-Álvarez and Alessandra Gorla. 2019. Release Practices for IOS and Android Apps. In WAMA 2019. ACM, New York, NY, USA. 15–18. isbn:9781450368582 Google ScholarGoogle Scholar
  5. Tianxiao Gu, Chengnian Sun, Xiaoxing Ma, Chun Cao, Chang Xu, Yuan Yao, Qirun Zhang, Jian Lu, and Zhendong Su. 2019. Practical GUI Testing of Android Applications via Model Abstraction and Refinement. In ICSE 2019. IEEE Press, 269–280. https://doi.org/10.1109/ICSE.2019.00042 Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Chanh Duc Ngo, Fabrizio Pastore, and Lionel Briand. 2021. Automated, Cost-effective, and Update-driven App Testing. ACM TOSEM, Dec., https://doi.org/10.1145/3502297 arXiv: 2012.02471. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Chanh Duc Ngo, Fabrizio Pastore, and Lionel Briand. 2022. ATUA replicability package. https://doi.org/10.5281/zenodo.5734090 Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Atanas Rountev and Dacong Yan. 2014. Static Reference Analysis for GUI Objects in Android Software. In CGO 2014. ACM, New York, NY, USA. 143:143–143:153. isbn:978-1-4503-2670-4 Google ScholarGoogle Scholar
  9. Aman Sharma and Rupesh Nasre. 2019. QADroid: Regression Event Selection for Android Applications. In ISSTA 2019. ACM, New York, NY, USA. 66–77. isbn:9781450362245 Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Porfirio Tramontana, Domenico Amalfitano, Nicola Amatucci, and Anna Rita Fasolino. 2019. Automated functional testing of mobile applications: a systematic mapping study. Software Quality Journal, 27, 1 (2019), 149–201. isbn:1573-1367 Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Wenyu Wang, Dengfeng Li, Wei Yang, Yurui Cao, Zhenwen Zhang, Yuetang Deng, and Tao Xie. 2018. An Empirical Study of Android Test Generation Tools in Industrial Cases. In ASE 2018. ACM, New York, NY, USA. 738–748. isbn:978-1-4503-5937-5 Google ScholarGoogle Scholar

Index Terms

  1. ATUA: an update-driven app testing tool

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      ISSTA 2022: Proceedings of the 31st ACM SIGSOFT International Symposium on Software Testing and Analysis
      July 2022
      808 pages
      ISBN:9781450393799
      DOI:10.1145/3533767

      Copyright © 2022 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 18 July 2022

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • short-paper

      Acceptance Rates

      Overall Acceptance Rate58of213submissions,27%

      Upcoming Conference

      ISSTA '24
    • Article Metrics

      • Downloads (Last 12 months)123
      • Downloads (Last 6 weeks)9

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader