Benedikt Hauptmann
ABSTRACT
Scripts for automated system tests often contain technical knowledge about the user interface (UI). This makes test scripts brittle and hard to maintain which leads to high maintenance costs. As a consequence, automation of system tests is often abandoned.
We present a model-driven approach that separates UI knowledge from test scripts. Tests are defined on a higher level, abstracting from UI usage. During test instantiation, abstract tests are enriched with UI information and executed against the system. We demonstrate the application of our approach to graphical UIs (GUIs) such as rich clients and web applications. To show the feasibility, we present a prototypical implementation testing the open-source application Bugzilla.
- IEEE Standard Computer Dictionary. A Compilation of IEEE Standard Computer Glossaries. IEEE Std 610, 1991. Google Scholar
Digital Library
- S. Berner, R. Weber, and R. K. Keller. Observations and lessons learned from automated testing. In Proceedings of the 27th international conference on Software engineering (ICSE '05), 2005. Google ScholarDigital Library
- A. Bertolino. Software testing research: Achievements, challenges, dreams. In Future of Software Engineering (FOSE '07), 2007. Google ScholarDigital Library
- G. Botterweck. A model-driven approach to the engineering of multiple user interfaces. In Proceedings of the Workshop on Model-driven development of advanced user interfaces (MDDAUI '06), 2006. Google ScholarDigital Library
- G. Calvary, J. Coutaz, D. Thevenin, Q. Limbourg, N. Souchon, L. Bouillon, M. Florins, and J. Vanderdonckt. Plasticity of user interfaces: A revised reference framework. In Proceedings of the First International Workshop on Task Models and Diagrams for User Interface Design, 2002. Google ScholarDigital Library
- E. Dustin, J. Rashka, and J. Paul. Automated software testing: introduction, management, and performance. Addison-Wesley, 1999. Google ScholarDigital Library
- M. Fewster and D. Graham. Software test automation: effective use of test execution tools. Addison-Wesley, 1999. Google ScholarDigital Library
- H. Grandy and S. Benz. Specification based testing of automotive human machine interfaces. In GI Jahrestagung, 2009.Google Scholar
- M. Grechanik, Q. Xie, and C. Fu. Maintaining and evolving gui-directed test scripts. In Proceedings of the 31st International Conference on Software Engineering (ICSE '09), 2009. Google ScholarDigital Library
- M. J. Harrold and A. Orso. Retesting software during development and maintenance. In Proceedings of the Frontiers of Software Maintenance (FoSM '08), 2008.Google ScholarCross Ref
- B. Hauptmann. Model-based test instantiation for applications with user interfaces. In Proc. Doctoral Symposium at the International Conference on Product Focused Software Development and Process Improvement (PROFES '11), 2011. Google ScholarDigital Library
- H. Hussmann, G. Meixner, and D. Zuehlke, editors. Model-Driven Development of Advanced User Interfaces. Springer, 2011. Google ScholarDigital Library
- M. Katara, A. Kervinen, M. Maunumaa, T. Paakkonen, and M. Satama. Towards deploying model-based testing with a domain-specific modeling approach. In Proceedings of the Testing: Academic & Industrial Conference on Practice And Research Techniques, 2006. Google ScholarDigital Library
- A. M. Memon and B. N. Nguyen. Advances in automated model-based system testing of software applications with a GUI front-end. In M. V. Zelkowitz, editor, Advances in Computers, volume 80. 2010.Google Scholar
- A. C. R. Paiva, N. Tillmann, J. C. P. Faria, and R. F. A. M. Vidal. Modeling and testing hierarchical GUIs. In Proceedings of the 12th International Workshop on Abstract State Machines, 2005.Google Scholar
- F. Paternò, C. Mancini, and S. Meniconi. Concurtasktrees: A diagrammatic notation for specifying task models. In Proceedings of the IFIP TC13 Interantional Conference on Human-Computer Interaction (INTERACT '97), 1997. Google ScholarDigital Library
- A. Pimenta. Automated Specification Based Testing of Graphical User Interfaces. PhD thesis, Engineering Faculty of Porto University, Department of Electrical and Computer Engineering, 2006.Google Scholar
- W. Prenninger, M. El-Ramly, and M. Horstmann. Case studies. In M. Broy, B. Jonsson, J.-P. Katoen, M. Leucker, and A. Pretschner, editors, Model-Based Testing of Reactive Systems, volume 3472 of Lecture Notes in Computer Science. Springer, 2005.Google Scholar
- W. Prenninger and A. Pretschner. Abstractions for model-based testing. Electron. Notes Theor. Comput. Sci., 116, January 2005. Google ScholarDigital Library
- R. K. Shehady and D. P. Siewiorek. A method to automate user interface testing using variable finite state machines. In Proceedings of the 27th International Symposium on Fault-Tolerant Computing (FTCS '97), 1997. Google ScholarDigital Library
- P. A. Szekely. Retrospective and challenges for model-based interface development. In Proceedings of the Second International Workshop on Computer-Aided Design of User Interfaces (CADUI'96), 1996.Google ScholarCross Ref
- M. Utting and B. Legeard. Practical Model-Based Testing: A Tools Approach. Morgan Kaufmann, 2006. Google ScholarDigital Library
- M. Utting, A. Pretschner, and B. Legeard. A taxonomy of model-based testing. Technical report, The University of Waikato, April 2006.Google Scholar
- M. Veanes, C. Campbell, W. Grieskamp, W. Schulte, N. Tillmann, and L. Nachmanson. Model-based testing of object-oriented reactive systems with spec explorer. Formal methods and testing, 2008. Google ScholarDigital Library
- S. Winter. Modellbasierte Analyse von Nutzerschnittstellen. Dissertation, Technische Universität München, München, 2009.Google Scholar
Index Terms
- Utilizing user interface models for automated instantiation and execution of system tests
Recommendations
Transportable Applications Environment (TAE) Plus user interface designer WorkBench
CHI '92: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsTAE Plus was built at NASA's Goddard Space Flight Center to support the building of GUI user interfaces for highly interactive applications, such as realtime processing systems and scientific analysis system. TAE Plus is designed as a productivity tool ...
The University of Alberta user interface management system
In this paper the design and implementation of the University of Alberta user interface management system (UIMS) is discussed. This UIMS is based on the Seeheim model of user interfaces, which divides the user interface into three separate components. ...
The University of Alberta user interface management system
SIGGRAPH '85: Proceedings of the 12th annual conference on Computer graphics and interactive techniquesIn this paper the design and implementation of the University of Alberta user interface management system (UIMS) is discussed. This UIMS is based on the Seeheim model of user interfaces, which divides the user interface into three separate components. ...
Comments