In the framework of a theory for invariant sensory signal representations, a signature which is invariant and selective for speech sounds can be obtained through projections in template signals and pooling over their transformations under a group. For locally compact groups, e.g., translations, the theory explains the resilience of convolutional neural networks with filter weight sharing and max pooling across their local translations in frequency or time. In this paper we propose a discriminative approach for learning an optimum set of templates, under a family of transformations, namely frequency transpositions and perturbations of the vocal tract length, which are among the primary sources of speech variability. Implicitly, we generalize convolutional networks to transformations other than translations, and derive data-specific templates by training a deep network with convolution-pooling layers and densely connected layers. We demonstrate that such a representation, combining group-generalized convolutions, theoretical invariance guarantees and discriminative template selection, improves frame classification performance over standard translation-CNNs and DNNs on TIMIT and Wall Street Journal datasets.
Cite as: Zhang, C., Voinea, S., Evangelopoulos, G., Rosasco, L., Poggio, T. (2015) Discriminative template learning in group-convolutional networks for invariant speech representations. Proc. Interspeech 2015, 3229-3233, doi: 10.21437/Interspeech.2015-650
@inproceedings{zhang15g_interspeech,
author={Chiyuan Zhang and Stephen Voinea and Georgios Evangelopoulos and Lorenzo Rosasco and Tomaso Poggio},
title={{Discriminative template learning in group-convolutional networks for invariant speech representations}},
year=2015,
booktitle={Proc. Interspeech 2015},
pages={3229--3233},
doi={10.21437/Interspeech.2015-650}
}