Abstract
The under-utilization of decision support systems (DSS) based on complex OR models is a reality faced by many OR/IS system designers. The research finding that DSS users trade off decision making effort versus decision accuracy has been utilized as a ready-made explanation for this phenomenon. That is, it has been argued that complex DSSs may never get to be used at all due to the increased effort required in using them. We argue, in contrast, that DSSs have been found to elicit a zero-sum effort versus accuracy tradeoff precisely because they are architecturally designed to do so. A modification of DSS architecture designed to deal with this problem is proposed, and a research prototype based upon this architecture is described. Two preliminary laboratory experiments designed to examine the utility of this prototype have indicated that DSS design can significantly impact the level of the effort versus accuracy tradeoff. We conclude, therefore, that the "complexity ceiling" which has heretofore limited the amount of complexity an OR/IS designer can usefully incorporate into DSSs is not inviolate.
Similar content being viewed by others
References
R.H. Ashton and S.S. Kramer, Students as surrogates in behavioral research: Some evidence, Journal of Accounting Research 68(1980)209–222.
L.R. Beach and T.R. Mitchell, A contingency model for the selection of decision strategies, Academy of Management Review 3(1978)439–449.
I. Benbasat and A.S. Dexter, Individual differences in the use of decision support aids, Journal of Accounting Research 20(1982)735–749.
I. Benbasat and R.N. Taylor, Behavioral aspects of information processing for the design of management information systems, IEEE Transactions on Systems, Man, and Cybernetics 12(1982) 439–450.
J.R. Bettman and P. Kakkar, Effects of information presentation format on consumer information acquisition, in: Advances in Consumer Research, Vol. 3, B. Anderson, ed., Association for Consumer Research, 1977, pp. 316–320.
J.R. Bettman, E.J. Johnson and J.W. Payne, A componential analysis of cognitive effort in choice, Organizational Behavior and Human Decision Processes 45(1990)111–139.
R.S. Billings and L.L. Scherer, The effects of response mode and importance on decision-making strategies: Judgment versus choice, Organizational Behavior and Human Decision Processes 41 (1988)1–19.
A.L. Brown, J.D. Bransford, R.A. Ferrara and J.C. Campione, Learning, remembering and understanding, in: Handbook of Child Psychology, 4th ed., Vol. 3, J.H. Flavell and E.M. Markham, eds., 1983, pp. 77–106.
J.S. Bruner, J.J. Goodnow and G.A. Austin, A Study of Thinking, Wiley, New York, 1956.
M.T.H. Chi, R. Glaser and E. Rees, Expertise in problem solving, in: Advances in the Psychology of Human Intelligence, Vol. 1, R.J. Sternberg, ed., Lawrence Erlbaum Associates, Hillsdale, NJ, 1982, pp. 7–75.
M.T.H. Chi, R. Glaser and M.J. Farr, The Nature of Expertise, Lawrence Erlbaum Associates, Hillsdale, NJ, 1988.
J.J.J. Christensen-Szalanski, Problem solving strategies: A selection mechanism, some implications and some data, Organizational Behavior and Human Performance 25(1980)307–323.
J.F. Courtney and D.B. Paradice, A knowledge based DSS for managerial problem diagnosis, Decision Sciences 18(1987)373–399.
A. Cypher, The structure of users' activities, in: User Centered System Design, D.A. Norman and S.W. Draper, eds., Lawrence Erlbaum Associates, Hillsdale, NJ, 1986, pp. 243–263.
D.R. Davies, D.M. Jones and A. Taylor, Selective-and sustained-attention tasks: Individual and group differences, in: Varieties of Attention, R. Parasuraman and D.R. Davies, eds., Academic Press, Orlando, FL, 1984, pp. 395–448.
B.L. Dos Santos and M.L. Bariff, A study of user interface aids for model-oriented Decision Support Systems, Management Science 34(1988)461–468.
S.W. Draper, Display managers as the basis for user-machine communication, in: User Centered System Design, D.A. Norman and S.W. Draper, eds., Lawrence Erlbaum Associates, Hillsdale, NJ, 1986, pp. 339–352.
J.E. Dutton, Interpretations on automatic: A different view of strategic issue diagnosis, Journal of Management Studies 30(1993)339–357.
H. Einhorn and R. Hogarth, Confidence in judgment: Persistence of the illusion of validity, Psychological Review 85(1978)395–416.
M. Gopalakrishnan, S. Gopalakrishnan and D.M. Miller, A Decision Support System for scheduling personnel in a newspaper publishing environment, Interfaces 23(1993)104–115.
S.J. Hoch and D.A. Schkade, A psychological approach to Decision Support Systems, Management Science 42(1996)51–64.
R. Hockey, Varieties of attentional state: The effects of environment, in: Varieties of Attention, R. Parasuraman and D.R. Davies, eds., Academic Press, Orlando, FL, 1984, pp. 449–484.
E.L. Hutchins, J.D. Hollan and D.A. Norman, Direct manipulation interfaces, in: User Centered System Design, D.A. Norman and S.W. Draper, eds., Lawrence Erlbaum Associates, Hillsdale, NJ, 1986, pp. 87–124.
E. Johnson, J. Payne and J. Bettman, Information displays and preference reversals, Organizational Behavior and Human Decision Processes 42(1988)1–21.
P.N. Johnson-Laird, Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness, Harvard University Press, Cambridge, MA, 1983.
D. Kahneman, Attention and Effort, Prentice-Hall, Englewood Cliffs, NJ, 1973.
I.P. Khera and J.D. Benson, Are students really poor substitutes of businessmen in behavioral research?, Journal of Marketing Research 7(1970)529–532.
L.B. Kurke and H.E. Aldrich, Mintzberg was right!: A replication and extension of the nature of managerial work, Management Science 29(1983)975–984.
J. Leplat, Task complexity in work situations, in: Tasks, Errors, and Mental Models, L.P. Goodstein, et al., eds., Taylor & Francis, London, 1988, pp. 105–115.
C. Lewis and D.A. Norman, Designing for error, in: User Centered System Design, D.A. Norman and S.W. Draper, eds., Lawrence Erlbaum Associates, Hillsdale, NJ, 1986, pp. 411–432.
S.L. Loy, The interaction effects between general thinking skills and an interactive graphics-based DSS to support problem structuring, Decision Sciences 23(1991)648–672.
E.J. Lusk, A test of differential performance peaking for a disembedding task, Journal of Accounting Research, Supplement (1973) 191–202.
G. March and H.A. Simon, Organizations, Wiley, New York, 1958.
G.A. Miller, The magical number seven, plus or minus two: Some limits on our capacity for processing information, Psychological Review 63(1956)81–97.
H. Mintzberg, Managerial work: Analysis from observation, Management Science 18(1971)B97–B110.
Y. Miyata and D.A. Norman, Psychological issues in support of multiple activities, in: User Centered System Design, D.A. Norman and S.W. Draper, eds., Lawrence Erlbaum Associates, Hillsdale, NJ, 1986, pp. 265–284.
K. Mykytyn, P.P. Mykytyn, Jr. and C.W. Slinkman, Expert systems: A question of liability?, MIS Quarterly (March 1990) 27–42.
D.A. Norman, Categorization of action slips, Psychological Review 88(1981)1–15.
D.A. Norman and T. Shallice, Attention to action: Willed and automatic control of behavior, in: Consciousness and Self-Regulation: Advances in Research, Vol. 4, R.J. Davidson, G.E. Schwartz and D. Shapiro, eds., Plenum Press, New York, 1985, pp. 1–18.
C.E. O'Malley, Helping users help themselves, in: User Centered System Design, D.A. Norman and S.W. Draper, eds., Lawrence Erlbaum Associates, Hillsdale, NJ, 1986, pp. 377–398.
L. Paquette and T. Kida, The effect of decision strategy and task complexity on decision performance, Organizational Behavior and Human Decision Processes 41(1988)128–142.
J.W. Payne, Contingent decision behavior, Psychological Bulletin 92(1982)382–402.
J.W. Payne, J.R. Bettman and E.J. Johnson, Adaptive strategy selection in decision making, Journal of Experimental Psychology: Learning, Memory, and Cognition 14(1988)534–552.
W.E. Pracht and J.F. Courtney, The effects of an integrative graphics-based DSS to support problem structuring, Decision Sciences 19(1988)598–621.
K.V. Ramani and B.K. Mandal, Operational planning of passenger trains in Indian railways, Interfaces 22(1992)39–51.
J. Rasmussen, Cognitive control and human error mechanisms, in: New Technology and Human Error, J. Rasmussen, K. Duncan and J. Leplat, eds., Wiley, Chichester, UK, 1987, pp. 53–61.
J.T. Reason, Generic error-modeling system (GEMS): A cognitive framework for locating common human error form, in: New Technology and Human Error, J. Rasmussen, K. Duncan and J. Leplat, eds., Wiley, Chichester, UK, 1987, pp. 63–83.
R. Reichman, Communication paradigms for a window system, in: User Centered System Design, D.A. Norman and S.W. Draper, eds., Lawrence Erlbaum Associates, Hillsdale, NJ, 1986, pp. 285–314.
J.C. Rivera, An empirical study of the effect of system response time and task complexity on user decision quality, Unpublished Doctoral Dissertation, Mississippi State University, Mississippi, MS, 1992.
S. Rodriguez, Training users of a flexible Decision Support System: The effects of training content and user ability, Unpublished Doctoral Dissertation, Case Western Reserve University, Cleveland, OH, 1991.
J. Russo and B. Dosher, Strategies for multiattribute binary choice, Journal of Experimental Psychology: Learning, Memory and Cognition 9(1983)676–696.
A.P. Sage, Behavioral and organizational considerations in the design of information systems and processes for planning and decision support, IEEE Transactions on Systems, Man, and Cybernetics SMC-11(1981)640–678.
A.P. Sage, Decision Support Systems Engineering, Wiley, New York, 1991.
J.D. Schmitz, G.D. Armstrong and J.D.C. Little, CoverStory — automated news finding in marketing, Interfaces 20(1990)29–38.
K. Sengupta and D. Te'eni, Cognitive feedback in GDSS: Improving control and convergence, MIS Quarterly 17(1993)87–113.
P.W. Shannon and R.P. Minch, A Decision Support System for motor vehicle taxation evaluation, Interfaces 22(1992)52–64.
H.A. Simon, Theories of decision making in economics and behavioral science, American Economic Review 49(1959)253–283.
H.A. Simon, The New Science of Management Decisions, Harper and Row, New York, 1960.
H.A. Simon, Rational decision making in business organizations, American Economic Review 69(1979)493–513.
P. Slovic, S. Lichtenstein and B. Fischhoff, Decision making, in: Steven's Handbook of Experimental Psychology, 2nd ed., R.C. Atkinson et al., eds., Wiley, New York, 1988.
R.J. Sternberg, Beyond IQ: A Triarchic Theory of Intelligence, Cambridge University Press, New York, 1985.
R.J. Sternberg, The Triarchic Mind: A New Theory of Human Intelligence, Viking, New York, 1988.
R. Stewart, Managers and their Jobs: A Study of the Similarities and Differences in the Ways Managers Spend their Time, 2nd ed., MacMillan, London, 1988.
R.N. Taylor, Psychological determinants of bounded rationality: Implications for decision making strategies, Decision Sciences 20(1975)166–181.
D. Te'eni, Analysis and design of process feedback in information systems: Old and new wine in new bottles, Accounting, Management, and Information Technologies 2(1992)1–18.
D. Thomassin Singh, Incorporating solution process monitoring tools into current Decision Support System architecture, Unpublished Doctoral Dissertation, Department of Management Information and Decision Systems, Case Western Reserve University, Cleveland, OH, 1994.
P. Todd and I. Benbasat, An experimental investigation of the impact of computer based decision aids on decision making strategies, Information Systems Research 2(1991)87–115.
P. Todd and I. Benbasat, The use of information in decision making: An experimental investigation of the impact of computer-based decision aids, MIS Quarterly 16(1992)373–393.
G.R. Walsh, Methods of Optimization, Wiley, London, 1975.
H.S. Weigel S.P. Wilcox, The army's personnel Decision Support System, Decision Support Systems 9(1993)281–306.
D.J. Wilde and C.S. Beightler, Foundations of Optimization, Prentice-Hall, Englewood Cliffs, NJ, 1976.
T. Winograd, Bringing Design to Software, Addison-Wesley, New York, 1996.
H.A. Witkin, P. Oltman, E. Ruskin and S. Karp, The Embedded Figures Test Manual, Consulting Psychologist Press, Palo Alto, CA, 1971.
D. Yang and W. Mou, An integrated Decision Support System in a Chinese chemical plant, Interfaces 23(1993)93–100.
Rights and permissions
About this article
Cite this article
Thomassin Singh, D., Pratap Singh, P. Aiding DSS users in the use of complex OR models. Annals of Operations Research 72, 5–27 (1997). https://doi.org/10.1023/A:1018908623751
Issue Date:
DOI: https://doi.org/10.1023/A:1018908623751