We extend our earlier work on deep-structured conditional random field (DCRF) and develop deep-structured hidden conditional random field (DHCRF). We investigate the use of this new sequential deep-learning model for phonetic recognition. DHCRF is a hierarchical model in which the final layer is a hidden conditional random field (HCRF) and the intermediate layers are zero-th-order conditional random fields (CRFs). Parameter estimation and sequence inference in the DHCRF are carried out layer by layer. Note that the training label is available only at the final layer and the state boundary is unknown. This difficulty is addressed by using unsupervised learning for the intermediate layers and lattice-based supervised learning in the final layer. Experiments on the TIMIT phone recognition task show small performance improvement of a three-layer DHCRF over a two-layer DHCRF, both are superior to the single-layer DHCRF and the discriminatively trained tri-phone HMM with same features.
Cite as: Yu, D., Deng, L. (2010) Deep-structured hidden conditional random fields for phonetic recognition. Proc. Interspeech 2010, 2986-2989, doi: 10.21437/Interspeech.2010-35
@inproceedings{yu10_interspeech,
author={Dong Yu and L. Deng},
title={{Deep-structured hidden conditional random fields for phonetic recognition}},
year=2010,
booktitle={Proc. Interspeech 2010},
pages={2986--2989},
doi={10.21437/Interspeech.2010-35}
}