skip to main content
10.5555/1613984.1614016dlproceedingsArticle/Chapter ViewAbstractPublication PageshltConference Proceedingsconference-collections
research-article
Free Access

Parsing conversational speech using enhanced segmentation

Published:02 May 2004Publication History

ABSTRACT

The lack of sentence boundaries and presence of disfluencies pose difficulties for parsing conversational speech. This work investigates the effects of automatically detecting these phenomena on a probabilistic parser's performance. We demonstrate that a state-of-the-art segmenter, relative to a pause-based segmenter, gives more than 45% of the possible error reduction in parser performance, and that presentation of interruption points to the parser improves performance over using sentence boundaries alone.

References

  1. E. Black et al. 1991. A procedure for quantitatively comparing syntactic coverage of English grammars. In Proc. 4th DARPA Speech&Natural Lang. Workshop, pages 306--311. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. E. Charniak and M. Johnson. 2001. Edit detection and parsing for transcribed speech. In Proc. 2nd NAACL, pages 118--126. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. C. Chelba and F. Jelinek. 2000. Structured language modeling. Computer Speech and Language, 14(4):283--332, October.Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. M. Core and K. Schubert. 1999. Speech repairs: A parsing perspective. In Satellite Meeting ICPHS 99.Google ScholarGoogle Scholar
  5. J. Huang and G. Zweig. 2002. Maximum entropy model for punctuation annotation from speech. In Proc. Eurospeech.Google ScholarGoogle Scholar
  6. J.-H. Kim and P. Woodland. 2001. The use of prosody in a combined system for punctuation generation and speech recognition. In Proc. Eurospeech, pages 2757--2760.Google ScholarGoogle Scholar
  7. J. Kim, S. E. Schwarm, and M. Ostendorf. 2004. Detecting structural metadata with decision trees and transformation-based learning. In Proc. HLT-NAACL.Google ScholarGoogle Scholar
  8. Y. Liu, E. Shriberg, and A. Stolcke. 2003. Automatic disfluency identification in conversational speech using multiple knowledge sources. In Proc. Eurospeech, volume 1, pages 957--960.Google ScholarGoogle Scholar
  9. L. Mayfield et al. 1995. Parsing real input in JANUS: a concept-based approach. In Proc. TMI 95.Google ScholarGoogle Scholar
  10. NIST. 2003. Rich Transcription Fall 2003 Evaluation Results. http://www.nist.gov/speech/tests/rt/rt2003/fall/.Google ScholarGoogle Scholar
  11. S. Sekine and M. Collins. 1997. EVALB. As in Collins ACL 1997; http://nlp.cs.nyu.edu/evalb/.Google ScholarGoogle Scholar
  12. S. Strassel, 2003. Simple Metadata Annotation Specification V5.0. Linguistic Data Consortium.Google ScholarGoogle Scholar
  1. Parsing conversational speech using enhanced segmentation

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image DL Hosted proceedings
        HLT-NAACL-Short '04: Proceedings of HLT-NAACL 2004: Short Papers
        May 2004
        171 pages
        ISBN:1932432248

        Publisher

        Association for Computational Linguistics

        United States

        Publication History

        • Published: 2 May 2004

        Qualifiers

        • research-article

        Acceptance Rates

        Overall Acceptance Rate240of768submissions,31%

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader