In an earlier experiment we studied the effect of desynchronisation of visual and auditory information on the perception of nonsense CVC-words. Predictably, percent correctly recognized words was generally smaller in asynchronous conditions than in the synchronous condition. However, an asymmetrical effect was found: subjects' performance was poorer in the condition where audition preceded vision than when vision preceded audition. In order to gain insight into this asymmetrical effect and its causes, we have now examined subjects' responses to nonsense words on the phoneme level. Analysis of the individual phonemes which made up the original CVC-stimuli indicates that identification of the initial consonant was worse when vision preceded audition than vice versa. In contrast to this, identification of both the vowel and the final consonant was poorer when audition preceded vision. This effect of phoneme position may serve to explain why perception deteriorates more when audition precedes vision than when vision leads.
Cite as: Smeele, P.M.T., Sittig, A.C., Heuven, V.J.v. (1992) Intelligibility of audio-visually desynchronised speech: asymmetrical effect of phoneme position. Proc. 2nd International Conference on Spoken Language Processing (ICSLP 1992), 65-68, doi: 10.21437/ICSLP.1992-19
@inproceedings{smeele92_icslp,
author={P. M. T. Smeele and A. C. Sittig and Vincent J. van Heuven},
title={{Intelligibility of audio-visually desynchronised speech: asymmetrical effect of phoneme position}},
year=1992,
booktitle={Proc. 2nd International Conference on Spoken Language Processing (ICSLP 1992)},
pages={65--68},
doi={10.21437/ICSLP.1992-19}
}