Technical Program

Paper Detail

Presentation #4
Session:ASR IV
Location:Kallirhoe Hall
Session Time:Friday, December 21, 13:30 - 15:30
Presentation Time:Friday, December 21, 13:30 - 15:30
Presentation: Poster
Topic: Speech recognition and synthesis:
Paper Title: MULTICHANNEL ASR WITH KNOWLEDGE DISTILLATION AND GENERALIZED CROSS CORRELATION FEATURE
Authors: Wenjie Li, Yu Zhang, Pengyuan Zhang, Fengpei Ge, Key Laboratory of Speech Acoustics and Content Understanding, Institute of Acoustics, China
Abstract: Multi-channel signal processing techniques have played an important role in the far-field automatic speech recognition (ASR) as the separate front-end enhancement part. How- ever, they often meet the mismatch problem. In this paper, we proposed a novel architecture of acoustic model, in which the multi-channel speech without preprocessing was utilized directly. Besides the strategy of knowledge distillation and the generalized cross correlation (GCC) adaptation were em- ployed. We use knowledge distillation to transfer knowledge from a well-trained close-talking model to distant-talking s- cenarios in every frame of the multichannel distant speech. Moreover, the GCC between microphones, which contains the spatial information, is supplied as an auxiliary input to the neural network. We observe good compensation of those two techniques. Evaluated with the AMI and ICSI meeting corpo- ra, the proposed methods achieve relative WER improvement of 7.7% and 7.5% over the model trained directly on the con- catenated multi-channel speech.