ABSTRACT
Performance and usability of real-world speech-to-speech translation systems, like the one developed within the NESPOLE! project, are affected by several aspects that go beyond the pure translation quality provided by the underlying components of the system. In this paper we describe these aspects as perspectives along which we have evaluated the NESPOLE! system. Four main issues are investigated: (1) assessing system performance under various network traffic conditions; (2) a study on the usage and utility of multi-modality in the context of multi-lingual communication; (3) a comparison of the features of the individual speech recognition engines, and (4) an end-to-end evaluation of the system.
- Susanne Burger, Laurent Besacier, Paolo Coletti, Florian Metze, and Celine Morel. 2001. The NESPOLE! VoIP Dialogue Database. In Proc. EuroSpeech 2001, Aalborg, Denmark. ISCA.Google Scholar
- Erica Costantini, Susanne Burger, and Fabio Pianesi. 2002. Nespole!'s multilingual and multimodal corpus. In Proceedings of the Third International Conference on Language Resources and Evaluation (LREC-2002), Grand Canary Island, Spain, June. To appear.Google Scholar
- Alon Lavie, Fabio Pianesi, and al. 2001. Architecture and Design Considerations in NESPOLE!: a Speech Translation System for E-Commerce Applications. In Proc. of the HLT2001, San Diego, CA. ACM. Google ScholarDigital Library
- Gianni Lazzari. 2001. Spoken translation: challenges and opportunities. In Proc. ICSLP 2001, Beijing, China, 10.Google Scholar
- Lori Levin, Donna Gates, Fabio Pianesi, Donna Wallace, Takeshi Watanabe, and Monika Woszczyna. 2000. Evaluation of a Practical Interlingua for Task-Oriented Dialogues. In Proceedings NAACL-2000 Workshop On Interlinguas and Interlingual Approaches, Seattle, WA. AMTA. Google ScholarDigital Library
- Florian Metze, John McDonough, and Hagen Soltau. 2001. Speech Recognition over NetMeeting Connections. In Proc. EuroSpeech 2001, Aalborg, Denmark. ISCA.Google Scholar
- Florian Metze, John McDonough, Hagen Soltau, Alex Waibel, Alon Lavie, Susan Burger, Chad Langley, Kornel Laskowski, Lori Levin, Tanja Schultz, Fabio Pianesi, Roldano Cattoni, Gianni Lazzari, Nadia Mana, Emanuele Pianta, Laurent Besacier, Herve Blanchon, Dominique Vaufreydaz, and Loredana Taddei. 2002. The NESPOLE! Speech-to-Speech Translation System. In Proc. HLT 2002, San Diego, CA, 3. Google ScholarDigital Library
- Ben Milner and Sharam Semnani. 2000. Robust Speech Recognition over IP Networks. In Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP-00), Istanbul, Turkey, June.Google ScholarCross Ref
- Hagen Soltau, Thomas Schaaf, Florian Metze, and Alex Waibel. 2001. The ISL Evaluation System for Verbmobil - II. In Proc. ICASSP 2001, Salt Lake City, USA, 5.Google ScholarCross Ref
- D. Vaufreydaz, L. Besacier, C. Bergamini, and R. Lamy. 2001. presented at ISCA ITRW Workshop on Adaptation Methods for Speech Recognition, August. Sophia-Antipolis, France.Google Scholar
Recommendations
Architecture and design considerations in NESPOLE!: a speech translation system for e-commerce applications
HLT '01: Proceedings of the first international conference on Human language technology researchNESPOLE! is a speech-to-speech machine translation research project funded jointly by the European Commission and the US NSF. The main goal of the NESPOLE! project is to advance the state-of-the-art of speech-to-speech translation in a real-world ...
A dependency perspective on rst discourse parsing and evaluation
Computational text-level discourse analysis mostly happens within Rhetorical Structure Theory RST, whose structures have classically been presented as constituency trees, and relies on data from the RST Discourse Treebank RST-DT; as a result, the RST ...
Evaluation of machine translation
ICWET '11: Proceedings of the International Conference & Workshop on Emerging Trends in TechnologyMachine Translation (MT) refers to the use of a machine for performing translation task which converts text or speech from one Natural Language (NL) into another Natural Language. Machine Translation is an important technology for localization, and is ...
Comments