skip to main content
10.3115/1118656.1118673dlproceedingsArticle/Chapter ViewAbstractPublication Pagess2sConference Proceedingsconference-collections
Article
Free Access

A multi-perspective evaluation of the NESPOLE!: speech-to-speech translation system

Published:11 July 2002Publication History

ABSTRACT

Performance and usability of real-world speech-to-speech translation systems, like the one developed within the NESPOLE! project, are affected by several aspects that go beyond the pure translation quality provided by the underlying components of the system. In this paper we describe these aspects as perspectives along which we have evaluated the NESPOLE! system. Four main issues are investigated: (1) assessing system performance under various network traffic conditions; (2) a study on the usage and utility of multi-modality in the context of multi-lingual communication; (3) a comparison of the features of the individual speech recognition engines, and (4) an end-to-end evaluation of the system.

References

  1. Susanne Burger, Laurent Besacier, Paolo Coletti, Florian Metze, and Celine Morel. 2001. The NESPOLE! VoIP Dialogue Database. In Proc. EuroSpeech 2001, Aalborg, Denmark. ISCA.Google ScholarGoogle Scholar
  2. Erica Costantini, Susanne Burger, and Fabio Pianesi. 2002. Nespole!'s multilingual and multimodal corpus. In Proceedings of the Third International Conference on Language Resources and Evaluation (LREC-2002), Grand Canary Island, Spain, June. To appear.Google ScholarGoogle Scholar
  3. Alon Lavie, Fabio Pianesi, and al. 2001. Architecture and Design Considerations in NESPOLE!: a Speech Translation System for E-Commerce Applications. In Proc. of the HLT2001, San Diego, CA. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Gianni Lazzari. 2001. Spoken translation: challenges and opportunities. In Proc. ICSLP 2001, Beijing, China, 10.Google ScholarGoogle Scholar
  5. Lori Levin, Donna Gates, Fabio Pianesi, Donna Wallace, Takeshi Watanabe, and Monika Woszczyna. 2000. Evaluation of a Practical Interlingua for Task-Oriented Dialogues. In Proceedings NAACL-2000 Workshop On Interlinguas and Interlingual Approaches, Seattle, WA. AMTA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Florian Metze, John McDonough, and Hagen Soltau. 2001. Speech Recognition over NetMeeting Connections. In Proc. EuroSpeech 2001, Aalborg, Denmark. ISCA.Google ScholarGoogle Scholar
  7. Florian Metze, John McDonough, Hagen Soltau, Alex Waibel, Alon Lavie, Susan Burger, Chad Langley, Kornel Laskowski, Lori Levin, Tanja Schultz, Fabio Pianesi, Roldano Cattoni, Gianni Lazzari, Nadia Mana, Emanuele Pianta, Laurent Besacier, Herve Blanchon, Dominique Vaufreydaz, and Loredana Taddei. 2002. The NESPOLE! Speech-to-Speech Translation System. In Proc. HLT 2002, San Diego, CA, 3. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Ben Milner and Sharam Semnani. 2000. Robust Speech Recognition over IP Networks. In Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP-00), Istanbul, Turkey, June.Google ScholarGoogle ScholarCross RefCross Ref
  9. Hagen Soltau, Thomas Schaaf, Florian Metze, and Alex Waibel. 2001. The ISL Evaluation System for Verbmobil - II. In Proc. ICASSP 2001, Salt Lake City, USA, 5.Google ScholarGoogle ScholarCross RefCross Ref
  10. D. Vaufreydaz, L. Besacier, C. Bergamini, and R. Lamy. 2001. presented at ISCA ITRW Workshop on Adaptation Methods for Speech Recognition, August. Sophia-Antipolis, France.Google ScholarGoogle Scholar

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image DL Hosted proceedings
    S2S '02: Proceedings of the ACL-02 workshop on Speech-to-speech translation: algorithms and systems - Volume 7
    July 2002
    137 pages

    Publisher

    Association for Computational Linguistics

    United States

    Publication History

    • Published: 11 July 2002

    Qualifiers

    • Article

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader