Abstract
The application of user-expertise modeling for adaptive interfaces is confronted with a number of difficult challenges, namely, efficiency and reliability, the cost-benefit ratio, and the practical usability of user modeling techniques. We argue that many of these obstacles can be overcome by standard, automatic means of performing knowledge assessment. Within this perspective, we present the basis of a probabilistic user modeling approach, the POKS technique, which could serve as a standard user-expertise modeling tool.
The POKS technique is based on the cognitive theory of knowledge structures: a formalism for the representation of the order in which we learn knowledge units (KU). The technique permits the induction of knowledge structures from a small number of empirical data cases. It uses an evidence propagation scheme within these structures to infer an individual's knowledge state from a sample of KU. The empirical induction technique is based, in part, on statistical hypothesis testing over conditional probabilities that are determined by the KUs' learning order.
Experiments with this approach show that the technique is successful in partially inferring an individual's knowledge state, either through the monitoring of a user's behavior, or through a selective questioning process. However, the selective process, based on entropy minimization, is shown to be much more effective in reducing the standard error score of knowledge assessment than random sampling.
Similar content being viewed by others
References
Anastasi, A.: 1966,Psychological Testing. New York: The Macmillan Company.
Benyon, D., P. Innocent and D. Murray: 1987, ‘System Adaptivity and the Modeling of Stereotypes’.Proceedings of IFIP INTERACT'87: Human-Computer Interaction, pp. 245–253.
Bretch, B. and M. Jones: 1988, ‘Student Models: The Genetic Graph Approach’.International Journal of Man-Machine Studies 28(5), 483–504.
Buchanan, B. G. and E. H. Shortliffe (eds.): 1984,Rule-Based Expert Systems: The MYCIN Experiments of the Stanford Heuristic Programming Project. Reading, MA: Addison-Wesley.
Burton, R.: 1982, ‘Diagnosing Bugs in a Simple Procedural Skill’. In: D. Sleeman and J. Brown (eds.):Intelligent Tutoring Systems. London: Academic Press, pp. 155–192.
Chin, D.: 1989, ‘KNOME: Modeling What the User Knows in UC’. In: A. Kobsa and W. Wahlster (eds.):User Models in Dialog Systems. Berlin, Heidelberg: Springer-Verlag, pp, 74–107.
Cooper, G. and E. Herskovits: 1992: ‘A Bayesian Method for the Induction of Probabilistic Networks from Data’.Machine Learning 9, 309–347.
De Rosis, F., S. Pizzutilo, A. Russo, D. C. Berry and F. J. N. Molina: 1992: ‘Modeling the User Knowledge by Belief Networks’.User Modeling and User-Adapted Interaction 2(4), 367–388.
Desmarais, M. C., L. Giroux and S. Larochelle: 1993, ‘An Advice-Giving Interface Based on PlanRecognition and User Knowledge Assessment’.International Journal of Man-Machine Studies 39, 901–924.
Desmarais, M. C. and J. Liu: 1993, ‘Exploring the Applications of User-Expertise Assessment for Intelligent Interfaces’.InterCHI'93, Bridges between Worlds, pp. 308–313.
Desmarais, M. C. and M. Pavel: 1987, ‘User Knowledge Evaluation: An Experiment with UNIX’. In: H.-J. Bullinger and B. Shackel (eds.):Proceedings of Interact'87. Elsevier Science Publisher (North Holland), pp. 151–156.
Duda, R. O., P. E. Hart and N. J. Nilsson: 1976, ‘Subjective Bayesian Methods for Rule-Based Inference Systems’. In: B. L. Webber and N. J. Nilsson (eds.),Readings in Artificial Intelligence. Palo Alto, CA: Tioga Publishing, pp. 192–199.
Falmagne, J.-C., J.-P. Doignon, M. Koppen, M. Villano and L. Johannesen: 1990, ‘Introduction to Knowledge Spaces: How to Build, Test and Search Them’.Psychological Review 97(2), 201–224.
Gagné, R.: 1966:The Conditions of Learning. New York: Hold, Rinehart and Winston.
Geiger, D.: 1992, ‘Proceedings of the Eight Conference on Uncertainty in Artificial Intelligence’.Fourth International Conference on User Modeling, pp. 92–97.
Giarratano, J. C. and G. Riley: 1989,Expert Systems: Principles and Programming. Boston, MA: PWS-KENT Publishing.
Goldstein, I.: 1982, ‘The Genetic Graph: A Representation for the Evolution of Procedural Knowledge’. In: D. Sleeman and J. Brown (eds.):Intelligent Tutoring Systems. London: Academic Press, pp. 51–77.
Gordon, J. and E. H. Shortliffe: 1984, ‘The Dempster-Shafer Theory of Evidence’. In: B. G. Buchanan and E. H. Shortliffe (eds.),Rule-Based Expert Systems. Reading, MA: Addison-Wesley.
Heckerman, D.: 1991,Probabilistic Similarity Networks. Cambridge, MA: The MIT Press.
Heckerman, D.: 1995, ‘A Bayesian Approach to Learning Causal Networks’.Uncertainty in AI: Proceedings of the Eleventh Conference, pp. 285–295.
Heckerman, D. and D. Geiger: 1995, ‘Learning Bayesian Networks: A Unification for Discrete and Gaussian Domains’.Uncertainty in AI: Proceedings of the Eleventh Conference, pp. 274–284.
Heckerman, D., D. Geiger and D. Chickering: 1994, ‘Learning Bayesian Networks: The Combination of Knowledge and Statistical Data’.Uncertainty in AI: Proceedings of the Tenth Conference, pp. 293–301.
Henrion, M.: 1988, ‘Propagating Uncertainty in Bayesian Networks by Probabilistic Logic Sampling’.Proceedings of Uncertainty in Artificial Intelligence 4, pp. 149–163.
Kay, J.: 1994, ‘Lies, Damned Lies and Stereotypes: Pragmatic Approximations of Users’.Proceedings of the 4th International Conference on User Modeling, Hyannis, MA, pp. 175–184.
Kobsa, A.: 1992, ‘Towards Inferences in BGP-MS: Combining Modal Logic and Partition Hierarchies for User Modeling (Preliminary Report)’.Proceedings of the Third International Workshop on User Modeling, pp. 35–41.
Lauritzen, S. and D. Spiegelhalter: 1988, ‘Local Computations with Probabilities on Graphical Structures and Their Application to Expert Systems’.Journal of the Royal Statistical Society B 50, 157–224.
Lukas, J. and D. Albert: 1993, ‘Knowledge Assessment Based on Skill Assignment and Psychological Task Analysis’. In: G. Strube and K. Wender (eds.):The Cognitive Psychology of Knowledge. Elsevier Science, pp. 139–159.
Mislevy, R. J. and D. H. Gitomer: 1995, ‘The Role of Probability-Based Inference in an Intelligent Tutoring System’.User Modeling and User-Adapted Interaction, in this issue, pp. 253–282.
Pearl, J.: 1988,Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. San Mateo, CA: Morgan Kaufmann.
Pearl, J.: 1992, ‘Evidential Reasoning Using Stochastic Simulation of Causal Models’.Artificial Intelligence 32, 241–288.
Pitas, I., E. Milios and A. N. Venetsanopoulos: 1992, ‘A Minimum Entropy Approach to Rule Learning from Examples’.IEEE Transactions on Systems, Man and Cybernetics,22(4), 621–635.
Rich, E.: 1979, ‘User Modeling via Stereotypes’.Cognitive Science 3(3), 329–354.
Sleeman, D. and J. Brown (eds.): 1982,Intelligent Tutoring Systems. London: Academic Press.
Spiegelhalter, D., S. Lauritzen and R. Cowell: 1993, ‘Bayesian Analysis in Expert Systems’.Statistical Science 8, 219–282.
Takeuchi, A. and S. Otsuki: 1988, ‘A Study of Student Models and Learner-Machine Interaction’. In: P. Ercoli and R. Lewis (eds.):Artificial Intelligence Tools in Education. Amsterdam: North-Holland, pp. 87–104.
Zissos, A. and I. Witten: 1985, ‘User Modeling for a Computer Coach: A Case Study’.International Journal of Man-Machine Studies 23, 250–729.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Desmarais, M.C., Maluf, A. & Liu, J. User-expertise modeling with empirically derived probabilistic implication networks. User Model User-Adap Inter 5, 283–315 (1995). https://doi.org/10.1007/BF01126113
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF01126113