Abstract
The Text2Dialogue (T2D) system that we are developing allows digital content creators to generate attractive multi-modal dialogues presented by two virtual agents—by simply providing textual information as input. We use Rhetorical Structure Theory (RST) to decompose text into segments and to identify rhetorical discourse relations between them. These are then “acted out” by two 3D agents using synthetic speech and appropriate conversational gestures. In this paper, we present version 1.0 of the T2D system and focus on the novel technique that it uses for mapping rhetorical relations to question–answer pairs, thus transforming (monological) text into a form that supports dialogues between virtual agents.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
André, E.: The generation of multimedia presentations. In: Dale, R., Moisl, H., Somers, H. (eds.) Handbook of Natural Language Processing, pp. 305–327. Marcel Dekker, Inc. (2000)
André, E., Rist, T., van Mulken, S., Klesen, M., Baldes, S.: The automated design of believable dialogue for animated presentation teams. In: Cassell, J., Sullivan, J., Prevost, S., Churchill, E. (eds.) Embodied Conversational Agents, pp. 220–255. The MIT Press, Cambridge (2000)
Bäuerle, R., Zimmermann, T.: Fragesätze. In: von Stechow, A., Wunderlich, D. (eds.) Semantics. An International Handbook of Contemporary Research, Mouton de Gruyter, Berlin/New York, pp. 333–348 (1991)
Carlson, L., Marcu, D.: Discourse tagging reference manual. Technical Report ISI-TR-545, ISI (September 2001)
Cox, R., McKendree, J., Tobin, R., Lee, J., Mayes, T.: Vicarious learning from dialogue and discourse: A controlled comparison. Instructional Science 27, 431–458 (1999)
Craig, S., Gholson, B., Ventura, M., Graesser, A.: Tutoring Research Group: Overhearing dialogues and monologues in virtual tutoring sessions: Effects on questioning and vicarious learning. International Journal of Artificial Intelligence in Education 11, 242–253 (2000)
Davis, R.: Writing for Dialogue Scripts. A & C Black Ltd, London (1998)
Hofstadter, D.: Gödel, Escher, Bach: an Eternal Golden Braid. Basic Books, USA (1979)
Le, H.T., Abeysinghe, G.: A study to improve the efficiency of a discourse parsing system. In: Gelbukh, A. (ed.) CICLing 2003. LNCS, vol. 2588, pp. 101–114. Springer, Heidelberg (2003)
Mann, W.C., Thompson, S.A.: Rethorical structure theory: Toward a functional theory of text organization. Text 8(3), 243–281 (1988)
Mitkov, R., Ha, L.A., Karamanis, N.: A computer-aided environment for generating multiple-choice test items. Natural Language Engineering: Special Issue on using NLP for Educational Applications 12(2), 177–194 (2006)
Nadamoto, A., Tanaka, K.: Complementing your TV-viewing by web content automatically-transformed into TV-program-type content. In: Proceedings 13th Annual ACM International Conference on Multimedia, pp. 41–50. ACM Press, New York (2005)
Nischt, M., Prendinger, H., André, E., Ishizuka, M.: MPML3D: a reactive framework for the Multimodal Presentation Markup Language. In: Gratch, J., Young, M., Aylett, R., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, pp. 218–229. Springer, Heidelberg (2006)
Piwek, P., Power, R., Scott, D., van Deemter, K.: Generating multimedia presentations. From plain text to screenplay. In: Stock, O., Zancanaro, M. (eds.) Multimodal Intelligent Information Presentation, Text, Speech, and Language Technology, pp. 203–225. Springer, Heidelberg (2005)
Piwek, P., Power, R., Williams, S.: Generating scripts for personalized medical dialogues for patients. Technical Report 2006/06, Department of Computing, Faculty of Mathematics and Computing, The Open University, UK (2006)
Piwek, P., van Deemter, K.: Towards automated generation of scripted dialogue: some time-honoured strategies. In: EIDLOG 2002. Proceedings 6th Workshop on the Semantics and Pragmatics of Dialogue, pp. 141–148 (2002)
Reitter, D.: Rhetorical theory in LaTeX with the rst package, http://www.reitter-it-media.de/
Sumi, K., Tanaka, K.: Transforming E-contents into a storybook world with animations and dialogues using semantic tags. In: SeC 2005. Online Proceedings of WWW-05 Workshop on the Semantic Computing Initiative (2005), http://www.instsec.org/2005ws/
Tenny, C.L., Speas, P.: The interaction of clausal syntax, discourse roles, and information structure in questions. In: ESSLLI 2004 Workshop on Syntax, Semantics and Pragmatics of Questions, Université Henri Poincaré, France (2004)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Piwek, P., Hernault, H., Prendinger, H., Ishizuka, M. (2007). T2D: Generating Dialogues Between Virtual Agents Automatically from Text. In: Pelachaud, C., Martin, JC., André, E., Chollet, G., Karpouzis, K., Pelé, D. (eds) Intelligent Virtual Agents. IVA 2007. Lecture Notes in Computer Science(), vol 4722. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74997-4_16
Download citation
DOI: https://doi.org/10.1007/978-3-540-74997-4_16
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74996-7
Online ISBN: 978-3-540-74997-4
eBook Packages: Computer ScienceComputer Science (R0)