Abstract
Strategic knowledge is used by an agent to decide what action to perform next, where actions have consequences external to the agent. This article presents a computer-mediated method for acquiring strategic knowledge. The general knowledge acquisition problem and the special difficulties of acquiring strategic knowledge are analyzed in terms of representation mismatch: the difference between the form in which knowledge is available from the world and the form required for knowledge systems. ASK is an interactive knowledge acquisition tool that elicits strategic knowledge from people in the form of justifications for action choices and generates strategy rules that operationalize and generalize the expert's advice. The basic approach is demonstrated with a human-computer dialog in which ASK acquires strategic knowledge for medical diagnosis and treatment. The rationale for and consequences of specific design decisions in ASK are analyzed, and the scope of applicability and limitations of the approach are assessed. The paper concludes by discussing the contribution of knowledge representation to automated knowledge acquisition.
Article PDF
Similar content being viewed by others
References
Agre, P.E., and Chapman, D. 1987. Pengi: An implementation of a theory of activity. Proceedings of the Sixth National Conference on Artificial Intelligence (pp. 268–272). Seattle, Washington: Morgan Kaufmann.
Anderson, J.R. 1986. Knowledge compilation: the general learning mechanism. In R.S. Michalski, J.G. Carbonell, and T.M. Mitchell (Eds.), Machine learning: An artificial intelligence approach, (Vol. 2). San Mateo, CA: Morgan Kaufmann.
Ashley, K.D. 1989. Modelling legal argument: Reasoning with cases and hypotheticals. Cambridge, MA: MIT Press. Based on doctoral dissertation, Department of Computer and Information Science, University of Massachusetts, Amherst.
Bareiss, E.R. 1989. Exemplar-based knowledge acquisition: A unified approach to concept representation, classification, and learning. Boston: Academic Press. Based on doctoral dissertation, Department of Computer Science, University of Texas, Austin.
Benjamin, D.P. 1987. Learning strategies by reasoning about rules. Proceedings of the Tenth International Joint Conference on Artificial Intelligence (pp. 256–259). Milan, Italy: Morgan Kaufmann.
Bennett, J.S. 1985. ROGET: A knowledge-based system for acquiring the conceptual structure of a diagnostic expert system. Journal of Automated Reasoning, 1, 49–74.
Boose, J.H. 1986. Expertise Transfer for Expert System Design. New York: Elsevier.
Boose, J.H., and Bradshaw, J.M. 1987. Expertise transfer and complex problems: Using AQUINAS as a knowledge acquisition workbench for expert systems. International Journal of Man-Machine Studies, 26, 21–25.
Buchanan, B.G., Barstow, D.K., Bechtel, R., Bennett, J., Clancey, W., Kulikowski, C., Mitchell, T., and Waterman, D.A. 1983. Constructing an expert system. In F.Hayes-Roth, D.A. Waterman, and D.B. Lenat (Eds.), Building expert systems. Reading, MA: Addison-Wesley.
Buchanan, B.G., and Shortliffe, E.H. 1984. Rule-Based Expert Systems: The MYCIN Experiments of the Stanford Heuristic Programming Project. Reading, MA: Addison-Wesley.
Bylander, R., and Chandrasekaran, B. 1987. Generic tasks for knowledge-based reasoning: The “right” level of abstraction for knowledge acquisition. International Journal of Man-Machine Studies, 26, 231–244.
Chandrasekaran, B. 1983. Toward a taxonomy of problem-solving types. AI Magazine, 4, 9–17.
Chandrasekaran, B. 1986. Generic tasks in knowledge-based reasoning: High-level building blocks for expert system design. IEEE Expert, 1, 23–30.
Chandrasekaran, B. 1987. Towards a functional architecture for intelligence based on generic information processing tasks. Proceedings of the Tenth International Joint Conference on Artificial Intelligence (pp. 1183–1192). Milan, Italy: Morgan Kaufmann.
Chapman, D., and Agre, P.E. 1987. Abstract reasoning as emergent from concrete activity. In M.P. Georgeff and A.L. Lansky (Eds.), Reasoning About Actions and Plans, Proceedings of the 1986 Workshop at Timberline, Oregon (pp. 411–424).
Clancey, W.J. 1983a. The epistemology of a rule-based exper system—A framework for explanation. Artificial Intelligence, 20, 215–251.
Clancey, W.J. 1983b. The advantages of abstract control knowledge in expert system design. Proceedings of the Third National Conference on Artificial Intelligence (pp. 74–78). Washington, D.C.: Morgan Kaufmann.
Clancey, W.J. 1984. Details of the revised therapy algorithm. In B.G. Buchanan and E.H. Shortliffe (Eds.), Rule-based expert systems: The MYCIN experiments of the Stanford Heuristic Programming Project. Reading, MA: Addison-Wesley.
Clancey, W.J. 1985. Heuristic classification. Artificial Intelligence, 27, 289–350.
Clancey, W.J. 1988. Acquiring, representing, and evaluating a competence model of diagnosis. In Chi, Glaser, and Farr (Eds.), Contributions to the nature of expertise (pp. 343–418). Hillsdale, N.J.: Lawrence Erlbaum. Previously published as KSL Memo 84–2, Stanford University, February, 1984.
Clancey, W.J. 1989. Viewing knowledge bases as qualitative models. IEEE Expert, 4, 9–23. Previously published as Technical Report KSL-86–27, Stanford University.
Clancey, W.J., and Bock, C. 1988. Representing control knowledge as abstract tasks and metarules. In L. Bolc and M. Coombs (Eds.), Expert system applications (pp. 1–77). New York: Springer-Verlag.
Cohen, P.R., Day, D.S., Delisio, J., Greenberg, M., Kjeldsen, R., Suthers, D., and Berman, P. 1987. Management of uncertainty in medicine. International Journal of Approximate Reasoning, 1, 103–116.
Cohen, P.R., Greenberg, M., and Delisio, J. 1987. MU: A development environment for prospective reasoning systems. Proceedings of the Sixth National Conference on Artificial Intelligence (pp. 783–788). Seattle, Washington: Morgan Kaufmann.
Davis, R. 1976. Applications of meta-level knowledge to the construction, maintenance, and use of large knowledge bases. Doctoral dissertation, Computer Science Department, Stanford University. Reprinted in R. Davis and D.B. Lenat (Eds.), Knowledge-based systems in artificial intelligence. New York: McGraw-Hill, 1982.
DeJong, G., and Mooney, R.J. 1986. Explanation-based learning: An alternative view. Machine Learning, 1, 145–176.
Dietterich, T.G., and Bennett, J.S. 1988. Varieties of operationality. (Technical Report). Department of Computer Science, Oregon State University.
Dietterich, T.G., London, B., Clarkson, K., and Dromey, G. 1982. Learning and inductive inference. In P.R. Cohen and E. Feigenbaum (Eds.), The handbook of artificial intelligence (Vol. 3). Menlo Park, CA: Addison-Wesley.
Dietterich, T.G., and Michalski, R.S. 1983. A comparative review of selected methods for learning from examples. In R.S. Michalski, J.G. Carbonell, and T.M. Mitchell (Eds.), Machine learning: An artificial intelligence approach. San Mateo, CA: Morgan Kaufmann.
Dietterich, T.G., and Michalski, R.S. 1986. Learning to predict sequences. In R. Michalski, J. Carbonell, and T. Mitchell (Eds.), Machine learning: An artificial intelligence approach (Vol. 2). San Mateo, CA: Morgan Kaufmann.
Erman, L.D., Scott, A.C., and London, P.E. 1984. Separating and integrating control in a rule-based tool. Proceedings of the IEEE Workshop of Knowledge-base Systems (pp. 37–43). Denver, Colorado.
Eshelman, L. 1988. MOLE: A knowledge-acquisition tool for cover-and-differentiate systems. In S.Marcus (Ed.), Automating knowledge acquisition for expert systems. Boston: Kluwer Academic Publishers.
Firby, R.J. 1987. An investigation into reactive planning in complex domains. Proceedings of the Sixth National Conference on Artificial Intelligence (pp. 202–206). Seattle, Washington: Morgan Kaufmann.
Freiling, M.J., and Alexander, J.H. 1984. Diagrams and grammars: Tools for mass producing expert systems. Proceedings of the First Conference on Artificial Intelligence Applications (pp. 537–543). Denver, Colorado: IEEE Computer Society Press.
Friedland, P.E., and Iwasaki, Y. 1985. The concept and implementation of skeletal plans. Journal of Automated Reasoning, 1, 161–208.
Gale, W.A. 1987. Knowledge-based knowledge acquisition for a statistical consulting system. International Journal of Man-Machine Studies, 13, 81–116.
Golding, A., Rosenbloom, P.S., and Laird, J.E. 1987. Learning general search control from outside guidance. Proceedings of the Tenth International Joint Conference on Artificial Intelligence (pp. 334–337). Milan, Italy: Morgan Kaufmann.
Gruber, T.R. 1989. The Acquisition of Strategic Knowledge. Boston: Academic Press. Based on doctoral dissertation, Department of Computer and Information Science, University of Massachusetts.
Gruber, T.R., and Cohen, P.R. 1987. Design for acquisition: Principles of knowledge system design to facilitate knowledge acquisition. International Journal of Man-Machine Studies, 26, 143–159.
Hammond, K.J. 1989. Case-based Planning: Viewing Planning as a Memory Task. Boston: Academic Press. Based on doctoral dissertation, Computer Science Department, Yale University.
Hannan, J., and Politakis, P. 1985. ESSA: An approach to acquiring decision rules for diagnostic expert systems. Proceedings of the Second Conference on Artificial Intelligence Applications (pp. 520–525). Orlando, Florida: IEEE Computer Society Press.
Hayes-Roth, B. 1985. A blackboard architecture for control. Artificial Intelligence, 26, 251–321.
Hayes-Roth, B., Garvey, A., Johnson, M., and Hewett, M. 1987. A layered environment for reasoning about action. (Technical Report KSL 86–38). Stanford, CA: Computer Science Department, Stanford University.
Hayes-Roth, B., and Hewett, M. 1985. Learning control heuristics in a blackboard environment. (Technical Report HPP-85–2). Stanford, CA: Computer Science Department, Stanford University.
Hutchins, E.L., Hollan, J.D., and Norman, D.A. 1986. Direct manipulation interfaces. In D.A. Norman, and S.W. Draper (Eds.), User centered system design. Hillsdale, NJ: Lawrence Erlbaum Associates.
Johnson, N.E., and Tomlinson, C.M. 1988. Knowledge representation for knowledge elicitation. Proceedings of the Third AAAI Knowledge Acquisition for Knowledge-based Systems Workshop, Banff, Canada, November. Calgary, Alberta: SRDG Publications, Department of Computer Science, University of Calgary.
Kaelbling, L.P. 1987. An architecture for intelligent reactive systems. In M.P. Georgeff and A.L. Lansky (Eds.), reasoning About Actions and Plans, Proceedings of the 1986 Workshop at Timberline, Oregon (pp. 411–424). Morgan Kaufmann.
Kassirer, J.P., and Gorry, G.A. 1978. Clinical problem solving: A behavioral analysis. Annals of Internal Medicine, 89, 245–255.
Kay, A. 1984. Computer software. Scientific American, 251, 52–59, September.
Keeney, R.L., and Raiffa, H. 1976. Decisions with Multiple Objectives: Preferences and Value Tradeoffs. John Wiley and Sons.
Keller, R.M. 1988. Defining operationality for explanation-based learning. Artificial Intelligence, 35, 227–241.
Klinker, G. 1988. KNACK: Sample-driven knowledge acquisition for reporting systems. In S.Marcus (Ed.), Automating knowledge acquisition for expert systems. Boston: Kluwer Academic Publishers.
Laird, J.D., Newell, A., and Rosenbloom, P.S. 1987. SOAR: An architecture for general intelligence. Artificial Intelligence, 33, 1–64.
Lenat, D.B., and Brown, J.S. 1984. Why AM and EURISKO appear to work. Artificial Intelligence, 23, 269–294.
Marcus, S. 1987. Taking backtracking with a grain of SALT. International Journal of Man-Machine Studies, 24, 383–398.
Marcus, S. 1988. SALT: A knowledge acquisition tool for propose-and-refine systems. In S.Marcus (Ed.), Automating knowledge acquisition for expert systems. Boston: Kluwer Academic Publishers.
McDermott, J. 1988. Preliminary steps toward a taxonomy of problem-solving methods. In S.Marcus (Ed.), Automating knowledge acquisition for expert systems. Boston: Kluwer Academic Publishers.
Minton, S., and Carbonell, J.G. 1987. Strategies for learning search control rules: An explanation-based approach. Proceedings of the Tenth International Joint Conference on Artificial Intelligence, Milan, Italy: Morgan Kaufmann.
Mitchell, T.M. 1982. Generalization as search. Artificial Intelligence, 18, 203–226.
Mitchell, T.M., Keller, R.M., and Kedar-Cabelli, S.T. 1986. Explanation-based generalization: A unifying view. Machine Learning, 1, 56–80.
Mitchell, T.M., Mahadevan, S., and Steinberg, L.I. LEAP: A learning apprentice for VLSI design. Proceedings of the Ninth International Conference on Artificial Intelligence (pp. pp573–580). Los Angeles, CA: Morgan Kaufmann.
Mitchell, T.M., Utgoff, P.E., and Banerji, R.B. 1983. Learning by experimentation: Acquiring and refining problem-solving heuristics. In R.S. Michalski, J.G. Carbonell, and T.M. Mitchell (Eds.), Machine Learning: An Artificial Intelligence Approach, San Mateo, CA: Morgan Kaufmann.
Mostow, D.J. 1983. Machine transformation of advice into a heuristic search procedure. In R. Michalski, J. Carbonell, and T.M. Mitchell (Eds.), Machine learning: An artificial intelligence approach. San Mateo, CA: Morgan Kaufmann.
Morik, K. 1988. Sloppy modeling. In K. Morik (Ed.), Knowledge representation and organization in machine learning. Berlin: Springer-Verlag, in press.
Musen, M.A. 1989. Automated Generation of Model-based Knowledge-Acquisition Tools, London: Pitman. Based on doctoral dissertation, Computer Science Department, Stanford University.
Musen, M.A., Fagan, L.M., and Shortliffe, E.H. 1986. Graphical specification of procedural knowledge for an expert system. Proceedings of the 1986 IEEE Computer Society Workshop in Visual Languages (pp. 167–178). Dallas, Texas.
Musen, M.A., Fagan, L.M., Combs, D.M., and Shortliffe, E.H. 1987. Use of a domain model to drive an interactive knowledge editing tool. International Journal of Man-Machine Studies, 26, 105.
Neches, R., Swartout, W., and Moore, J. 1985. Enhanced maintenance and explanation of expert systems through explicit models of their development. IEEE Transactions on Software Engineering, SE-11 (11), 1337–1351.
Newell, A. 1982. The knowledge level. Artificial Intelligence, 18, 87–127.
Nisbett, R., and Wilson, T. 1977. Telling more than we can know: Verbal reports on mental processes. Psychological Review, 84, 231–259.
Pauker, S.G., Kassirer, J.P. 1981. Clinical decision analysis by personal computer. Archives of Internal Medicine, 141, 1831–1837.
Quilan, J.R. 1983. Learning efficient classification procedures and their application to chess end games. In R. Michalski, J. Carbonell, and T. Mitchell (Eds.), Machine learning: An artificial intelligence approach. San Mateo, CA: Morgan Kaufmann.
Quinlan, J.R. 1986. Induction of decision trees. Machine Learning, 1 (1), 81–106.
Sacerdoti, E.D. 1974. Planning in a hierarchy of abstraction spaces. Artificial Intelligence, 5, 115–135.
Schachter, R.D., and Heckerman, D.E. 1987. Thinking backward for knowledge acquisition. Al Magazine, 8, 55–61.
Shaw, M.L.G., and Gaines, B. 1987. Techniques for knowledge acquisition and transfer. International Journal of Man-Machine Studies, 27.
Shortliffe, E.H., Scott, A.C., Bischoff, M.B., vanMelle, W., and Jacobs, C.D. 1981. ONCOCIN: An expert system for oncology protocol management. Proceedings of the Seventh International Joint Conference on Artificial Intelligence (pp. 876–881). Vancouver, British Columbia: Morgan Kaufmann.
Silver, B. 1986. Metal-level Inference: Representing and Learning Control Information in Artificial Intelligence. New York: North-Holland.
Sticklen, J., Chandrasekaran, B., and Josephson, J.R. 1985. Control issues in classificatory diagnosis. Proceedings of the Ninth International Joint Conference on Artificial Intelligence (pp. 300–306). Los Angeles, CA: Morgan Kaufmann.
Swartout, W., 1983. XPLAIN: A system for creating and explaining expert consulting systems. Artificial Intelligence, 11, 115–144.
Tu, S.W., Kahn, M.G., Musen, M.A., Ferguson, J.C., Shortliffe, E.H., and Fagan, L.M. 1989. Episodic monitoring of time-oriented data for heuristic skeletal-plan refinement. Communications of the ACM, in press.
Utgoff, P. 1986. Machine Learning of Inductive Bias. Boston: Kluwer Academic Publishers. Based on doctoral dissertation, Department of Computer Science, Rutgers University.
Waterman, D.A. 1970. Generalization learning techniques for automating the learning of heuristics. Artificial Intelligence, 1, 121–170.
Winograd, T., and Flores, F. 1987. Understanding Computers and Cognition. Reading, MA: Addison-Wesley.
Winston, P.H. 1985. Learning structural descriptions from examples. In P.H.Winston (Ed.), The Psychology of Computer Vision, New York: McGraw Hill.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Gruber, T.R. Automated knowledge acquisition for strategic knowledge. Mach Learn 4, 293–336 (1989). https://doi.org/10.1007/BF00130716
Issue Date:
DOI: https://doi.org/10.1007/BF00130716