Suzanne Rivard
Abstract
For several years now, software quality has been a major concern for those involved in the area of software engineering, and researchers as well as practitioners of the domain have proposed instruments to measure it. Application quality is also a concern for researchers and managers involved in the area of end-user computing. However, since end-user computing research is in a much earlier stage than research in software engineering, relatively few efforts have been made to assess the quality of user-developed applications. Building on earlier work in software engineering and in end-user computing, this study developed and assessed a measure of user-developed applications quality. The quality construct comprises eight dimensions: reliability, effectiveness, portability, economy, user-friendliness, understandability, verifiability, and maintainability. In turn, each quality dimension is composed of a set of criteria. Finally, each criterion is measured by a series of items. The instrument was tested by means of a survey involving 110 end-users. Confirmatory factor analysis, using the partial least squares technique, was conducted. The results indicate that the 56-items instrument is reliable and valid, and that it may be a useful tool for researchers and for practitioners alike.
- Amoroso, D.L., and Cheney, P.H. (1992). "A Quality-End-User Developed Applications: Some Essential Ingredients," DataBase, Vol. 23, No. 1, pp. 1-12. Google Scholar
Digital Library
- Andriole, S.J. (1986). "A Quality Assurance through Verification," Software Validation, Verification, Testing, and Documentation, Princeton: Petrocelle Books, pp. 81-88. Google ScholarDigital Library
- Arthur, L.J. (1985). Measuring Programmer Productivity and Software Quality, New York: John Wiley & Sons. Google ScholarDigital Library
- Bagozzi, R.P. (1981). "An Examination of the Validity of Two Models of Attitude", Multivariate Behavioral Research, Vol. 16, pp. 323-359.Google ScholarCross Ref
- Bagozzi, R.P. (1983). "A Holistic Methodology for Modeling Consumer Response to Innovation," Operations Research, Vol. 31, pp. 128-176.Google ScholarDigital Library
- Barclay, D., Higgins, C.A., and Thompson, R.L. (1993). "A The Partial Least Squares (PLS) Approach to Causal Modeling: Personal Computer Use as an Illustration," Working Paper MIS-90-O007-3, School of Business Administration, University of Vermont.Google Scholar
- Bergeron, F., Rivard, S., and Raymond, L. (1993). "Assessment of End-User Computing from an Organizational Perspective," Information Resources Management Journal, Vol. 6, No. 1, pp. 14-25.Google ScholarDigital Library
- Boehm, B.W., Brown, J.R., McLeod, G., Lipow, and Merrit, M. (1978). "A Characteristics of Software Quality," TRW Series on Software Technology, Amsterdam: North-Holland.Google Scholar
- Cavano, J.P., and McCall, J.A. (1978). "A Framework of Software Quality," Proceedings of the Software Quality and Assurance Workshop, San Diego: CA pp. 133-139. Google ScholarDigital Library
- Churchill, G.A., Jr. (1979). "A Paradigm for Developing Better Measures of Marketing Constructs," Journal of Marketing Research, Vol. XV, pp. 64-73.Google ScholarCross Ref
- Cho, C.K. (1980). An Introduction to Software Quality Control, New York: Wiley Interscience. Google ScholarDigital Library
- Claudle, S. L., Gorr, W.L., and Newcomer, K.E. (1991). "Key Information Systems Management Issues for the Public Sector," MIS Quarterly, Vol. 15, No. 2, pp. 171-188. Google ScholarDigital Library
- Computerworld. (1988). "The Premier 100," pp. 10-17.Google Scholar
- Computerworld. (1989). "The Premier 100," pp. 10-17.Google Scholar
- Computerworld. (1990). "The Premier 100," pp. 18-25.Google Scholar
- Computerworld. (1991). "The Premier 100," pp. 14-21.Google Scholar
- Computerworld. (1991,-2). "Forecast 1992," December 23/january 2. p. 1.Google Scholar
- Computerworld. (1992). "The Premier 100," pp. 54-61.Google Scholar
- Doll, W.J., and Torkzadeh, G. (1988). "The Measurement of End-User Computing Satisfaction," MIS Quarterly, Vol. 12, No. 2, pp. 259-274. Google ScholarDigital Library
- Farbey, B. (1990). "Software Quality Metrics: Considerations about Requirements and Requirement Specifications," Information and Software Technology, Vol. 32, No. 1. Google ScholarDigital Library
- Fornell, C.R., and Bookstein, F.L. (1982). "Two Structural Equation Models: LISREL and PLS Applied to Consumer Exit-Voice Theory," Journal of Marketing Research, Vol. 19, pp. 440-452.Google ScholarCross Ref
- Fornell, C.R., and Larcker, D.F. (1981). "Structural Equation Models With Unobservable Variables and Measurement Error," Journal of Marketing Research, Vol. 18, pp. 39-50.Google ScholarCross Ref
- Fornell, C.R., Tellis , G.J., and Zinkhan, G.M. (1982). "Validity Assessment: A Structural Equations Approach Using Partial least Squares," AMA Educator's Proceedings, Chicago, pp. 405-409.Google Scholar
- Gilb, T. (1977). Software Metrics, Cambridge, MA: Winthrop Publishers.Google Scholar
- International Organization for Standardization. (1990). "Information Technology -- Software Product Evaluation, Quality Characteristics, and Guidelines for their Use," UDC 683.3.06.006.83.Google Scholar
- Kidder, L.H. (1981). Research Methods in Social Relations, New-York: Holt, Rinehart and Winston.Google Scholar
- McLean, E.R. (1979). "End-Users as Application Developer," MIS Quarterly, Vol. 3, No. 3, pp. 37-46.Google ScholarDigital Library
- Meyer, K., and Harper, M. (1984). "User Friendliness," MIS Quarterly, Vol. 8, No. 1, pp. 1-3.Google ScholarDigital Library
- Nelson, R.R. (1991). "Educational Needs as Perceived by IS and End-User Personnel," MIS Quarterly, Vol. 15, No. 4, pp. 503-525.Google ScholarDigital Library
- Niederman, F., Brancheau, J.C., and Wetherbe, J.C., (1991). "Information Systems Management Issues for the 1990s," MIS Quarterly, Vol. 15, No. 4, pp. 475-500.Google ScholarDigital Library
- Nunnally, J.C. (1978). Psychometric Theory, New York: McGraw-Hill.Google Scholar
- Plans, J. (1988). La qualité informatique, Paris: Dunod.Google Scholar
- Petrova, E., and Veevers, A. (1990). "A Role of Non-Stochastic-Based Metrics in Quantification of Software Reliability," Information and Software Technology, Vol. 32, No. 1, pp. 71-77. Google ScholarDigital Library
- Raymond, L., Bergeron, F., Gingras, L., and Rivard, S. (1988). "A qualité des applications de la micro-informatique: les utilisateurs sont-ils de bons concepteurs?" Gestion, Vol. 13, No. 4, pp. 34-40.Google Scholar
- Rivard, S., and Huff, S.L. (1985). "An Empirical Study of User as Application Developers," Information & Management, Vol. 8, No. 2, pp. 89-102. Google ScholarDigital Library
- Rivard, S., and Huff, S.L. (1988). "Factors of Success for End-User Computing," Communications of the ACM, Vol. 31, No. 5, pp. 552-561. Google ScholarDigital Library
- Rivard, S., Lebrun, P., and Talbot, J. (1991). "Measuring the Quality of User-Developed Applications," Proceedings of the 24th Hawaii International Conference on Systems Science, pp. 471-478.Google Scholar
- Robillard, P.N., Coupal, D., and Coallier, F. (1991). "A Profiling Software Through the Use of Metrics," Software -- Practice and Experience , Vol. 21, No. 5, pp. 507-518. Google ScholarDigital Library
- Schneiderman, B. (1980). Software Psychology: Human Factors in Computer and Information Systems, Cambridge, MA: Winthrop Publishers. Google ScholarDigital Library
- Sipior, J.C., and Sanders, G.L., (1989). "Definitional Distinctions and Implications for Managing End User Computing," Information & Management, Vol. 16, No. 3, pp. 45-123. Google ScholarDigital Library
- Sullivan-Trainor, M., and Dix, L.Z. (1993). "Winning the Paper Chase," Computerworld, Vol. 27, No. 1, p. 39.Google Scholar
- Sumner, M. (1986). "User-Developed Applications: What Are They Doing?," Journal of Information Systems Management, Vol. 3, No. 4, pp. 37-46.Google ScholarCross Ref
- Venkatraman, N., and Grant, J.H. (1986). "Construct Measurement in Strategy Research: A Critique and Proposal," Academy of Management Review, Vol. 11, pp. 71-86.Google ScholarCross Ref
- Werts, C.E., Rock, D.R., Linn, R.L., and Joreskog, K.B. (1978). "A General Method of Estimating the Reliability of a Composite," Educational and Psychological Measurement, Vol. 38, pp. 933-938.Google ScholarCross Ref
- Wold, H. (1982). "Soft Modeling: The Basic Design and Some Extensions," in Systems Under Indirect Observation, Joreskog, K.G. and Wold, H. (Eds.), Amsterdam: North-Holland, pp. 1-54.Google Scholar
- Zloof, M.M. (1978). "Design Aspects of the Query-by-Example Data Base Management Language," in Databases: Improving Usability and Responsiveness, B. Schneiderman, Ed. New York: Academic Press.Google Scholar
Index Terms
- Development of a measure to assess the quality of user-developed applications
Recommendations
User-Perceived Quality of Interactive Systems
User-perceived quality of interactive systems is defined in terms of statistically nonoverlapping categories, so-called dimensions or factors Categories are identified by factor analysis and represent a dimensional concept of the quality of interactive ...
User-developed applications: an empirical study of application quality and developer productivity
As inexpensive microcomputers and easy-to-use software have proliferated throughout organizations, increasing numbers of employees are developing applications. The end-user computing (EUC) literature contains many prescriptions for managing this ...
Quality end user-developed applications: some essential ingredients
This article examines the dimension of quality in end user-developed applications. Quality is defined as the degree to which an application of "high grade" accomplishes or attains its goal from the perspective of the user. We propose a definition for "...
Comments