Skip to main content
Log in

User-expertise modeling with empirically derived probabilistic implication networks

  • Published:
User Modeling and User-Adapted Interaction Aims and scope Submit manuscript

Abstract

The application of user-expertise modeling for adaptive interfaces is confronted with a number of difficult challenges, namely, efficiency and reliability, the cost-benefit ratio, and the practical usability of user modeling techniques. We argue that many of these obstacles can be overcome by standard, automatic means of performing knowledge assessment. Within this perspective, we present the basis of a probabilistic user modeling approach, the POKS technique, which could serve as a standard user-expertise modeling tool.

The POKS technique is based on the cognitive theory of knowledge structures: a formalism for the representation of the order in which we learn knowledge units (KU). The technique permits the induction of knowledge structures from a small number of empirical data cases. It uses an evidence propagation scheme within these structures to infer an individual's knowledge state from a sample of KU. The empirical induction technique is based, in part, on statistical hypothesis testing over conditional probabilities that are determined by the KUs' learning order.

Experiments with this approach show that the technique is successful in partially inferring an individual's knowledge state, either through the monitoring of a user's behavior, or through a selective questioning process. However, the selective process, based on entropy minimization, is shown to be much more effective in reducing the standard error score of knowledge assessment than random sampling.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Anastasi, A.: 1966,Psychological Testing. New York: The Macmillan Company.

    Google Scholar 

  • Benyon, D., P. Innocent and D. Murray: 1987, ‘System Adaptivity and the Modeling of Stereotypes’.Proceedings of IFIP INTERACT'87: Human-Computer Interaction, pp. 245–253.

  • Bretch, B. and M. Jones: 1988, ‘Student Models: The Genetic Graph Approach’.International Journal of Man-Machine Studies 28(5), 483–504.

    Google Scholar 

  • Buchanan, B. G. and E. H. Shortliffe (eds.): 1984,Rule-Based Expert Systems: The MYCIN Experiments of the Stanford Heuristic Programming Project. Reading, MA: Addison-Wesley.

    Google Scholar 

  • Burton, R.: 1982, ‘Diagnosing Bugs in a Simple Procedural Skill’. In: D. Sleeman and J. Brown (eds.):Intelligent Tutoring Systems. London: Academic Press, pp. 155–192.

    Google Scholar 

  • Chin, D.: 1989, ‘KNOME: Modeling What the User Knows in UC’. In: A. Kobsa and W. Wahlster (eds.):User Models in Dialog Systems. Berlin, Heidelberg: Springer-Verlag, pp, 74–107.

    Google Scholar 

  • Cooper, G. and E. Herskovits: 1992: ‘A Bayesian Method for the Induction of Probabilistic Networks from Data’.Machine Learning 9, 309–347.

    Google Scholar 

  • De Rosis, F., S. Pizzutilo, A. Russo, D. C. Berry and F. J. N. Molina: 1992: ‘Modeling the User Knowledge by Belief Networks’.User Modeling and User-Adapted Interaction 2(4), 367–388.

    Google Scholar 

  • Desmarais, M. C., L. Giroux and S. Larochelle: 1993, ‘An Advice-Giving Interface Based on PlanRecognition and User Knowledge Assessment’.International Journal of Man-Machine Studies 39, 901–924.

    Google Scholar 

  • Desmarais, M. C. and J. Liu: 1993, ‘Exploring the Applications of User-Expertise Assessment for Intelligent Interfaces’.InterCHI'93, Bridges between Worlds, pp. 308–313.

  • Desmarais, M. C. and M. Pavel: 1987, ‘User Knowledge Evaluation: An Experiment with UNIX’. In: H.-J. Bullinger and B. Shackel (eds.):Proceedings of Interact'87. Elsevier Science Publisher (North Holland), pp. 151–156.

    Google Scholar 

  • Duda, R. O., P. E. Hart and N. J. Nilsson: 1976, ‘Subjective Bayesian Methods for Rule-Based Inference Systems’. In: B. L. Webber and N. J. Nilsson (eds.),Readings in Artificial Intelligence. Palo Alto, CA: Tioga Publishing, pp. 192–199.

    Google Scholar 

  • Falmagne, J.-C., J.-P. Doignon, M. Koppen, M. Villano and L. Johannesen: 1990, ‘Introduction to Knowledge Spaces: How to Build, Test and Search Them’.Psychological Review 97(2), 201–224.

    Google Scholar 

  • Gagné, R.: 1966:The Conditions of Learning. New York: Hold, Rinehart and Winston.

    Google Scholar 

  • Geiger, D.: 1992, ‘Proceedings of the Eight Conference on Uncertainty in Artificial Intelligence’.Fourth International Conference on User Modeling, pp. 92–97.

  • Giarratano, J. C. and G. Riley: 1989,Expert Systems: Principles and Programming. Boston, MA: PWS-KENT Publishing.

    Google Scholar 

  • Goldstein, I.: 1982, ‘The Genetic Graph: A Representation for the Evolution of Procedural Knowledge’. In: D. Sleeman and J. Brown (eds.):Intelligent Tutoring Systems. London: Academic Press, pp. 51–77.

    Google Scholar 

  • Gordon, J. and E. H. Shortliffe: 1984, ‘The Dempster-Shafer Theory of Evidence’. In: B. G. Buchanan and E. H. Shortliffe (eds.),Rule-Based Expert Systems. Reading, MA: Addison-Wesley.

    Google Scholar 

  • Heckerman, D.: 1991,Probabilistic Similarity Networks. Cambridge, MA: The MIT Press.

    Google Scholar 

  • Heckerman, D.: 1995, ‘A Bayesian Approach to Learning Causal Networks’.Uncertainty in AI: Proceedings of the Eleventh Conference, pp. 285–295.

  • Heckerman, D. and D. Geiger: 1995, ‘Learning Bayesian Networks: A Unification for Discrete and Gaussian Domains’.Uncertainty in AI: Proceedings of the Eleventh Conference, pp. 274–284.

  • Heckerman, D., D. Geiger and D. Chickering: 1994, ‘Learning Bayesian Networks: The Combination of Knowledge and Statistical Data’.Uncertainty in AI: Proceedings of the Tenth Conference, pp. 293–301.

  • Henrion, M.: 1988, ‘Propagating Uncertainty in Bayesian Networks by Probabilistic Logic Sampling’.Proceedings of Uncertainty in Artificial Intelligence 4, pp. 149–163.

    Google Scholar 

  • Kay, J.: 1994, ‘Lies, Damned Lies and Stereotypes: Pragmatic Approximations of Users’.Proceedings of the 4th International Conference on User Modeling, Hyannis, MA, pp. 175–184.

  • Kobsa, A.: 1992, ‘Towards Inferences in BGP-MS: Combining Modal Logic and Partition Hierarchies for User Modeling (Preliminary Report)’.Proceedings of the Third International Workshop on User Modeling, pp. 35–41.

  • Lauritzen, S. and D. Spiegelhalter: 1988, ‘Local Computations with Probabilities on Graphical Structures and Their Application to Expert Systems’.Journal of the Royal Statistical Society B 50, 157–224.

    Google Scholar 

  • Lukas, J. and D. Albert: 1993, ‘Knowledge Assessment Based on Skill Assignment and Psychological Task Analysis’. In: G. Strube and K. Wender (eds.):The Cognitive Psychology of Knowledge. Elsevier Science, pp. 139–159.

  • Mislevy, R. J. and D. H. Gitomer: 1995, ‘The Role of Probability-Based Inference in an Intelligent Tutoring System’.User Modeling and User-Adapted Interaction, in this issue, pp. 253–282.

  • Pearl, J.: 1988,Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. San Mateo, CA: Morgan Kaufmann.

    Google Scholar 

  • Pearl, J.: 1992, ‘Evidential Reasoning Using Stochastic Simulation of Causal Models’.Artificial Intelligence 32, 241–288.

    Google Scholar 

  • Pitas, I., E. Milios and A. N. Venetsanopoulos: 1992, ‘A Minimum Entropy Approach to Rule Learning from Examples’.IEEE Transactions on Systems, Man and Cybernetics,22(4), 621–635.

    Google Scholar 

  • Rich, E.: 1979, ‘User Modeling via Stereotypes’.Cognitive Science 3(3), 329–354.

    Google Scholar 

  • Sleeman, D. and J. Brown (eds.): 1982,Intelligent Tutoring Systems. London: Academic Press.

    Google Scholar 

  • Spiegelhalter, D., S. Lauritzen and R. Cowell: 1993, ‘Bayesian Analysis in Expert Systems’.Statistical Science 8, 219–282.

    Google Scholar 

  • Takeuchi, A. and S. Otsuki: 1988, ‘A Study of Student Models and Learner-Machine Interaction’. In: P. Ercoli and R. Lewis (eds.):Artificial Intelligence Tools in Education. Amsterdam: North-Holland, pp. 87–104.

    Google Scholar 

  • Zissos, A. and I. Witten: 1985, ‘User Modeling for a Computer Coach: A Case Study’.International Journal of Man-Machine Studies 23, 250–729.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Desmarais, M.C., Maluf, A. & Liu, J. User-expertise modeling with empirically derived probabilistic implication networks. User Model User-Adap Inter 5, 283–315 (1995). https://doi.org/10.1007/BF01126113

Download citation

  • Received:

  • Revised:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF01126113

Key words

Navigation