Skip to main content
SpringerLink
Log in

Metacognition and Learning in Spoken Dialogue Computer Tutoring

  • Conference paper
Intelligent Tutoring Systems (ITS 2010)

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 6094))

Included in the following conference series:

Abstract

We investigate whether four metacognitive metrics derived from student correctness and uncertainty values are predictive of student learning in a fully automated spoken dialogue computer tutoring corpus. We previously showed that these metrics predicted learning in a comparable wizarded corpus, where a human wizard performed the speech recognition and correctness and uncertainty annotation. Our results show that three of the four metacognitive metrics remain predictive of learning even in the presence of noise due to automatic speech recognition and automatic correctness and uncertainty annotation. We conclude that our results can be used to inform a future enhancement of our fully automated system to track and remediate student metacognition and thereby further improve learning.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Aleven, V., Roll, I. (eds.): AIED Workshop on Metacognition and Self-Regulated Learning in Intelligent Tutoring Systems (2007)

    Google Scholar 

  2. Roll, I., Aleven, V. (eds.): ITS Workshop on Meta-Cognition and Self-Regulated Learning in Educational Technologies (2008)

    Google Scholar 

  3. VanLehn, K., Siler, S., Murray, C.: Why do only some events cause learning during human tutoring? Cognition and Instruction 21(3) (2003)

    Google Scholar 

  4. Craig, S., Graesser, A., Sullins, J., Gholson, B.: Affect and learning: an exploratory look into the role of affect in learning with AutoTutor. Journal of Educational Media 29(3) (2004)

    Google Scholar 

  5. Litman, D., Forbes-Riley, K.: Improving (meta)cognitive tutoring by detecting and responding to uncertainty. In: Working Notes of the Cognitive and Metacognitive Educational Systems AAAI Symposium, Arlington, VA (November 2009)

    Google Scholar 

  6. Litman, D., Forbes-Riley, K.: Spoken tutorial dialogue and the feeling of another’s knowing. In: Proceedings 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL), London, UK (September 2009)

    Google Scholar 

  7. Forbes-Riley, K., Litman, D.: Designing and evaluating a wizarded uncertainty-adaptive spoken dialogue tutoring system. In: Computer Speech and Language, CSL (2010) (in press)

    Google Scholar 

  8. Forbes-Riley, K., Litman, D.: Adapting to student uncertainty improves tutoring dialogues. In: Proc. Intl. Conf. on Artificial Intelligence in Education (2009)

    Google Scholar 

  9. Pon-Barry, H., Schultz, K., Bratt, E.O., Clark, B., Peters, S.: Responding to student uncertainty in spoken tutorial dialogue systems. International Journal of Artificial Intelligence in Education 16, 171–194 (2006)

    Google Scholar 

  10. Aist, G., Kort, B., Reilly, R., Mostow, J., Picard, R.: Experimentally augmenting an intelligent tutoring system with human-supplied capabilities: Adding human-provided emotional scaffolding to an automated reading tutor that listens. In: Proc. Intelligent Tutoring Systems Workshop on Empirical Methods for Tutorial Dialogue Systems (2002)

    Google Scholar 

  11. Tsukahara, W., Ward, N.: Responding to subtle, fleeting changes in the user’s internal state. In: Proc. SIG-CHI on Human Factors in Computing Systems (2001)

    Google Scholar 

  12. Forbes-Riley, K., Litman, D., Rotaru, M.: Responding to student uncertainty during computer tutoring: A preliminary evaluation. In: Woolf, B.P., Aïmeur, E., Nkambou, R., Lajoie, S. (eds.) ITS 2008. LNCS, vol. 5091, pp. 60–69. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  13. Nietfeld, J.L., Enders, C.K., Schraw, G.: A monte carlo comparison of measures of relative and absolute monitoring accuracy. Educational and Psychological Measurement (2006)

    Google Scholar 

  14. Kelemen, W.L., Frost, P.J., Weaver, C.A.: Individual differences in metacognition: Evidence against a general metacognitive ability. Memory and Cognition 28, 92–107 (2000)

    Google Scholar 

  15. VanLehn, K., Jordan, P.W., Rosé, C., Bhembe, D., Böttner, M., Gaydos, A., Makatchev, M., Pappuswamy, U., Ringenberg, M., Roque, A., Siler, S., Srivastava, R., Wilson, R.: The architecture of Why2-Atlas: A coach for qualitative physics essay writing. In: Cerri, S.A., Gouardéres, G., Paraguaçu, F. (eds.) ITS 2002. LNCS, vol. 2363, p. 158. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  16. Jordan, P., Hall, B., Ringenberg, M., Cui, Y., Ros, C.: Tools for authoring a dialogue agent that participates in learning studies. In: Proceedings of Artificial Intelligence in Education (AIED), Los Angeles, July 2007, pp. 43–50 (2007)

    Google Scholar 

  17. Smith, V.L., Clark, H.H.: On the course of answering questions. Journal of Memory and Language (1993)

    Google Scholar 

  18. Brennan, S.E., Williams, M.: The feeling of another’s knowing: Prosody and filled pauses as cues to listeners about the metacognitive states of speakers. Journal of Memory and Language (1995)

    Google Scholar 

  19. Dijkstra, C., Krahmer, E., Swerts, M.: Manipulating uncertainty: The contribution of different audiovisual prosodic cues to the perception of confidence. In: Proc. Speech Prosody (2006)

    Google Scholar 

  20. Saadawi, G.M.E., Azevedo, R., Castine, M., Payne, V., Medvedeva, O., Tseytlin, E., Legowski, E., azen Jukic, D., Crowley, R.S.: Factors affecting feeling-of-knowing in a medical intelligent tutoring system: the role of immediate feedback as a metacognitive scaffold. Adv. in Helth Sci. Educ. (2009)

    Google Scholar 

  21. Litman, D., Moore, J., Dzikovska, M., Farrow, E.: Using natural language processing to analyze tutorial dialogue corpora across domains and modalities. In: Proc. Intl. Conf. on Artificial Intelligence in Education (2009)

    Google Scholar 

  22. D’Mello, S.K., Craig, S.D., Witherspoon, A., McDaniel, B., Graesser, A.: Automatic detection of learner’s affect from conversational cues. User Modeling and User-Adapted Interaction: Journal of Personalization Research 18, 45–80 (2008)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Learning Research and Development Center, University of Pittsburgh, 3939 O’Hara St., Pittsburgh, PA, 15260

    Kate Forbes-Riley & Diane Litman

Authors
  1. Kate Forbes-Riley
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Diane Litman
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Human-Computer Interaction Institute, Carnegie Mellon University, 5000 Forbes Avenue, 15213, Pittsburgh, PA, USA

    Vincent Aleven  & Jack Mostow  & 

  2. School of Information Technologies, University of Sydney, 1 Cleveland Street, 2006, Sydney, Australia

    Judy Kay

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Forbes-Riley, K., Litman, D. (2010). Metacognition and Learning in Spoken Dialogue Computer Tutoring. In: Aleven, V., Kay, J., Mostow, J. (eds) Intelligent Tutoring Systems. ITS 2010. Lecture Notes in Computer Science, vol 6094. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-13388-6_42

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-13388-6_42

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-13387-9

  • Online ISBN: 978-3-642-13388-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation