Skip to main content
Log in

Aiding DSS users in the use of complex OR models

  • Published:
Annals of Operations Research Aims and scope Submit manuscript

Abstract

The under-utilization of decision support systems (DSS) based on complex OR models is a reality faced by many OR/IS system designers. The research finding that DSS users trade off decision making effort versus decision accuracy has been utilized as a ready-made explanation for this phenomenon. That is, it has been argued that complex DSSs may never get to be used at all due to the increased effort required in using them. We argue, in contrast, that DSSs have been found to elicit a zero-sum effort versus accuracy tradeoff precisely because they are architecturally designed to do so. A modification of DSS architecture designed to deal with this problem is proposed, and a research prototype based upon this architecture is described. Two preliminary laboratory experiments designed to examine the utility of this prototype have indicated that DSS design can significantly impact the level of the effort versus accuracy tradeoff. We conclude, therefore, that the "complexity ceiling" which has heretofore limited the amount of complexity an OR/IS designer can usefully incorporate into DSSs is not inviolate.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. R.H. Ashton and S.S. Kramer, Students as surrogates in behavioral research: Some evidence, Journal of Accounting Research 68(1980)209–222.

    Google Scholar 

  2. L.R. Beach and T.R. Mitchell, A contingency model for the selection of decision strategies, Academy of Management Review 3(1978)439–449.

    Google Scholar 

  3. I. Benbasat and A.S. Dexter, Individual differences in the use of decision support aids, Journal of Accounting Research 20(1982)735–749.

    Google Scholar 

  4. I. Benbasat and R.N. Taylor, Behavioral aspects of information processing for the design of management information systems, IEEE Transactions on Systems, Man, and Cybernetics 12(1982) 439–450.

    Google Scholar 

  5. J.R. Bettman and P. Kakkar, Effects of information presentation format on consumer information acquisition, in: Advances in Consumer Research, Vol. 3, B. Anderson, ed., Association for Consumer Research, 1977, pp. 316–320.

  6. J.R. Bettman, E.J. Johnson and J.W. Payne, A componential analysis of cognitive effort in choice, Organizational Behavior and Human Decision Processes 45(1990)111–139.

    Google Scholar 

  7. R.S. Billings and L.L. Scherer, The effects of response mode and importance on decision-making strategies: Judgment versus choice, Organizational Behavior and Human Decision Processes 41 (1988)1–19.

    Google Scholar 

  8. A.L. Brown, J.D. Bransford, R.A. Ferrara and J.C. Campione, Learning, remembering and understanding, in: Handbook of Child Psychology, 4th ed., Vol. 3, J.H. Flavell and E.M. Markham, eds., 1983, pp. 77–106.

  9. J.S. Bruner, J.J. Goodnow and G.A. Austin, A Study of Thinking, Wiley, New York, 1956.

    Google Scholar 

  10. M.T.H. Chi, R. Glaser and E. Rees, Expertise in problem solving, in: Advances in the Psychology of Human Intelligence, Vol. 1, R.J. Sternberg, ed., Lawrence Erlbaum Associates, Hillsdale, NJ, 1982, pp. 7–75.

    Google Scholar 

  11. M.T.H. Chi, R. Glaser and M.J. Farr, The Nature of Expertise, Lawrence Erlbaum Associates, Hillsdale, NJ, 1988.

    Google Scholar 

  12. J.J.J. Christensen-Szalanski, Problem solving strategies: A selection mechanism, some implications and some data, Organizational Behavior and Human Performance 25(1980)307–323.

    Google Scholar 

  13. J.F. Courtney and D.B. Paradice, A knowledge based DSS for managerial problem diagnosis, Decision Sciences 18(1987)373–399.

    Google Scholar 

  14. A. Cypher, The structure of users' activities, in: User Centered System Design, D.A. Norman and S.W. Draper, eds., Lawrence Erlbaum Associates, Hillsdale, NJ, 1986, pp. 243–263.

    Google Scholar 

  15. D.R. Davies, D.M. Jones and A. Taylor, Selective-and sustained-attention tasks: Individual and group differences, in: Varieties of Attention, R. Parasuraman and D.R. Davies, eds., Academic Press, Orlando, FL, 1984, pp. 395–448.

    Google Scholar 

  16. B.L. Dos Santos and M.L. Bariff, A study of user interface aids for model-oriented Decision Support Systems, Management Science 34(1988)461–468.

    Google Scholar 

  17. S.W. Draper, Display managers as the basis for user-machine communication, in: User Centered System Design, D.A. Norman and S.W. Draper, eds., Lawrence Erlbaum Associates, Hillsdale, NJ, 1986, pp. 339–352.

    Google Scholar 

  18. J.E. Dutton, Interpretations on automatic: A different view of strategic issue diagnosis, Journal of Management Studies 30(1993)339–357.

    Google Scholar 

  19. H. Einhorn and R. Hogarth, Confidence in judgment: Persistence of the illusion of validity, Psychological Review 85(1978)395–416.

    Google Scholar 

  20. M. Gopalakrishnan, S. Gopalakrishnan and D.M. Miller, A Decision Support System for scheduling personnel in a newspaper publishing environment, Interfaces 23(1993)104–115.

    Google Scholar 

  21. S.J. Hoch and D.A. Schkade, A psychological approach to Decision Support Systems, Management Science 42(1996)51–64.

    Google Scholar 

  22. R. Hockey, Varieties of attentional state: The effects of environment, in: Varieties of Attention, R. Parasuraman and D.R. Davies, eds., Academic Press, Orlando, FL, 1984, pp. 449–484.

    Google Scholar 

  23. E.L. Hutchins, J.D. Hollan and D.A. Norman, Direct manipulation interfaces, in: User Centered System Design, D.A. Norman and S.W. Draper, eds., Lawrence Erlbaum Associates, Hillsdale, NJ, 1986, pp. 87–124.

    Google Scholar 

  24. E. Johnson, J. Payne and J. Bettman, Information displays and preference reversals, Organizational Behavior and Human Decision Processes 42(1988)1–21.

    Google Scholar 

  25. P.N. Johnson-Laird, Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness, Harvard University Press, Cambridge, MA, 1983.

    Google Scholar 

  26. D. Kahneman, Attention and Effort, Prentice-Hall, Englewood Cliffs, NJ, 1973.

    Google Scholar 

  27. I.P. Khera and J.D. Benson, Are students really poor substitutes of businessmen in behavioral research?, Journal of Marketing Research 7(1970)529–532.

    Google Scholar 

  28. L.B. Kurke and H.E. Aldrich, Mintzberg was right!: A replication and extension of the nature of managerial work, Management Science 29(1983)975–984.

    Google Scholar 

  29. J. Leplat, Task complexity in work situations, in: Tasks, Errors, and Mental Models, L.P. Goodstein, et al., eds., Taylor & Francis, London, 1988, pp. 105–115.

    Google Scholar 

  30. C. Lewis and D.A. Norman, Designing for error, in: User Centered System Design, D.A. Norman and S.W. Draper, eds., Lawrence Erlbaum Associates, Hillsdale, NJ, 1986, pp. 411–432.

    Google Scholar 

  31. S.L. Loy, The interaction effects between general thinking skills and an interactive graphics-based DSS to support problem structuring, Decision Sciences 23(1991)648–672.

    Google Scholar 

  32. E.J. Lusk, A test of differential performance peaking for a disembedding task, Journal of Accounting Research, Supplement (1973) 191–202.

    Google Scholar 

  33. G. March and H.A. Simon, Organizations, Wiley, New York, 1958.

    Google Scholar 

  34. G.A. Miller, The magical number seven, plus or minus two: Some limits on our capacity for processing information, Psychological Review 63(1956)81–97.

    Google Scholar 

  35. H. Mintzberg, Managerial work: Analysis from observation, Management Science 18(1971)B97–B110.

    Google Scholar 

  36. Y. Miyata and D.A. Norman, Psychological issues in support of multiple activities, in: User Centered System Design, D.A. Norman and S.W. Draper, eds., Lawrence Erlbaum Associates, Hillsdale, NJ, 1986, pp. 265–284.

    Google Scholar 

  37. K. Mykytyn, P.P. Mykytyn, Jr. and C.W. Slinkman, Expert systems: A question of liability?, MIS Quarterly (March 1990) 27–42.

  38. D.A. Norman, Categorization of action slips, Psychological Review 88(1981)1–15.

    Google Scholar 

  39. D.A. Norman and T. Shallice, Attention to action: Willed and automatic control of behavior, in: Consciousness and Self-Regulation: Advances in Research, Vol. 4, R.J. Davidson, G.E. Schwartz and D. Shapiro, eds., Plenum Press, New York, 1985, pp. 1–18.

    Google Scholar 

  40. C.E. O'Malley, Helping users help themselves, in: User Centered System Design, D.A. Norman and S.W. Draper, eds., Lawrence Erlbaum Associates, Hillsdale, NJ, 1986, pp. 377–398.

    Google Scholar 

  41. L. Paquette and T. Kida, The effect of decision strategy and task complexity on decision performance, Organizational Behavior and Human Decision Processes 41(1988)128–142.

    Google Scholar 

  42. J.W. Payne, Contingent decision behavior, Psychological Bulletin 92(1982)382–402.

    Google Scholar 

  43. J.W. Payne, J.R. Bettman and E.J. Johnson, Adaptive strategy selection in decision making, Journal of Experimental Psychology: Learning, Memory, and Cognition 14(1988)534–552.

    Google Scholar 

  44. W.E. Pracht and J.F. Courtney, The effects of an integrative graphics-based DSS to support problem structuring, Decision Sciences 19(1988)598–621.

    Google Scholar 

  45. K.V. Ramani and B.K. Mandal, Operational planning of passenger trains in Indian railways, Interfaces 22(1992)39–51.

    Google Scholar 

  46. J. Rasmussen, Cognitive control and human error mechanisms, in: New Technology and Human Error, J. Rasmussen, K. Duncan and J. Leplat, eds., Wiley, Chichester, UK, 1987, pp. 53–61.

    Google Scholar 

  47. J.T. Reason, Generic error-modeling system (GEMS): A cognitive framework for locating common human error form, in: New Technology and Human Error, J. Rasmussen, K. Duncan and J. Leplat, eds., Wiley, Chichester, UK, 1987, pp. 63–83.

    Google Scholar 

  48. R. Reichman, Communication paradigms for a window system, in: User Centered System Design, D.A. Norman and S.W. Draper, eds., Lawrence Erlbaum Associates, Hillsdale, NJ, 1986, pp. 285–314.

    Google Scholar 

  49. J.C. Rivera, An empirical study of the effect of system response time and task complexity on user decision quality, Unpublished Doctoral Dissertation, Mississippi State University, Mississippi, MS, 1992.

  50. S. Rodriguez, Training users of a flexible Decision Support System: The effects of training content and user ability, Unpublished Doctoral Dissertation, Case Western Reserve University, Cleveland, OH, 1991.

  51. J. Russo and B. Dosher, Strategies for multiattribute binary choice, Journal of Experimental Psychology: Learning, Memory and Cognition 9(1983)676–696.

    Google Scholar 

  52. A.P. Sage, Behavioral and organizational considerations in the design of information systems and processes for planning and decision support, IEEE Transactions on Systems, Man, and Cybernetics SMC-11(1981)640–678.

    Google Scholar 

  53. A.P. Sage, Decision Support Systems Engineering, Wiley, New York, 1991.

    Google Scholar 

  54. J.D. Schmitz, G.D. Armstrong and J.D.C. Little, CoverStory — automated news finding in marketing, Interfaces 20(1990)29–38.

    Google Scholar 

  55. K. Sengupta and D. Te'eni, Cognitive feedback in GDSS: Improving control and convergence, MIS Quarterly 17(1993)87–113.

    Google Scholar 

  56. P.W. Shannon and R.P. Minch, A Decision Support System for motor vehicle taxation evaluation, Interfaces 22(1992)52–64.

    Google Scholar 

  57. H.A. Simon, Theories of decision making in economics and behavioral science, American Economic Review 49(1959)253–283.

    Google Scholar 

  58. H.A. Simon, The New Science of Management Decisions, Harper and Row, New York, 1960.

    Google Scholar 

  59. H.A. Simon, Rational decision making in business organizations, American Economic Review 69(1979)493–513.

    Google Scholar 

  60. P. Slovic, S. Lichtenstein and B. Fischhoff, Decision making, in: Steven's Handbook of Experimental Psychology, 2nd ed., R.C. Atkinson et al., eds., Wiley, New York, 1988.

    Google Scholar 

  61. R.J. Sternberg, Beyond IQ: A Triarchic Theory of Intelligence, Cambridge University Press, New York, 1985.

    Google Scholar 

  62. R.J. Sternberg, The Triarchic Mind: A New Theory of Human Intelligence, Viking, New York, 1988.

    Google Scholar 

  63. R. Stewart, Managers and their Jobs: A Study of the Similarities and Differences in the Ways Managers Spend their Time, 2nd ed., MacMillan, London, 1988.

    Google Scholar 

  64. R.N. Taylor, Psychological determinants of bounded rationality: Implications for decision making strategies, Decision Sciences 20(1975)166–181.

    Google Scholar 

  65. D. Te'eni, Analysis and design of process feedback in information systems: Old and new wine in new bottles, Accounting, Management, and Information Technologies 2(1992)1–18.

    Google Scholar 

  66. D. Thomassin Singh, Incorporating solution process monitoring tools into current Decision Support System architecture, Unpublished Doctoral Dissertation, Department of Management Information and Decision Systems, Case Western Reserve University, Cleveland, OH, 1994.

  67. P. Todd and I. Benbasat, An experimental investigation of the impact of computer based decision aids on decision making strategies, Information Systems Research 2(1991)87–115.

    Google Scholar 

  68. P. Todd and I. Benbasat, The use of information in decision making: An experimental investigation of the impact of computer-based decision aids, MIS Quarterly 16(1992)373–393.

    Google Scholar 

  69. G.R. Walsh, Methods of Optimization, Wiley, London, 1975.

    Google Scholar 

  70. H.S. Weigel S.P. Wilcox, The army's personnel Decision Support System, Decision Support Systems 9(1993)281–306.

    Google Scholar 

  71. D.J. Wilde and C.S. Beightler, Foundations of Optimization, Prentice-Hall, Englewood Cliffs, NJ, 1976.

    Google Scholar 

  72. T. Winograd, Bringing Design to Software, Addison-Wesley, New York, 1996.

    Google Scholar 

  73. H.A. Witkin, P. Oltman, E. Ruskin and S. Karp, The Embedded Figures Test Manual, Consulting Psychologist Press, Palo Alto, CA, 1971.

    Google Scholar 

  74. D. Yang and W. Mou, An integrated Decision Support System in a Chinese chemical plant, Interfaces 23(1993)93–100.

    Google Scholar 

Download references

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Thomassin Singh, D., Pratap Singh, P. Aiding DSS users in the use of complex OR models. Annals of Operations Research 72, 5–27 (1997). https://doi.org/10.1023/A:1018908623751

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1018908623751

Keywords

Navigation