An evaluation system for ascertaining the quality of synthetic speech based on subjective category rating tests

Harald Klaus, H. Klix, Jochem Sotscheck, Klaus Fellbaum

This paper describes the hardware and software architecture of an evaluation system for mean opinion score category rating tests. It is primarily designed for ascertaining the quality of synthetic speech. The first part describes the hardware components of the evaluation system and details of the evaluation methodology to determine the quality of synthetic speech samples. Experiments with 23 test subjects were performed to optimize the dialogue interface and the test procedures. Details of the optimization process and experimental results are outlined in the second part of the paper. The system was developed at the Institute of Telecommunications of the Technical University of Berlin in co-operation with the Berlin Branch of the Research and Technology Centre of the German Telekom.

Keywords: Synthetic Speech, Evaluation, Subjective

doi: 10.21437/Eurospeech.1993-378

Cite as: Klaus, H., Klix, H., Sotscheck, J., Fellbaum, K. (1993) An evaluation system for ascertaining the quality of synthetic speech based on subjective category rating tests. Proc. 3rd European Conference on Speech Communication and Technology (Eurospeech 1993), 1679-1682, doi: 10.21437/Eurospeech.1993-378

@inproceedings{klaus93_eurospeech,
  author={Harald Klaus and H. Klix and Jochem Sotscheck and Klaus Fellbaum},
  title={{An evaluation system for ascertaining the quality of synthetic speech based on subjective category rating tests}},
  year=1993,
  booktitle={Proc. 3rd European Conference on Speech Communication and Technology (Eurospeech 1993)},
  pages={1679--1682},
  doi={10.21437/Eurospeech.1993-378}
}