Paper ID | SPE-35.4 |
Paper Title |
DENSELY CONNECTED MULTI-STAGE MODEL WITH CHANNEL WISE SUBBAND FEATURE FOR REAL-TIME SPEECH ENHANCEMENT |
Authors |
JingDong Li, Dawei Luo, Yun Liu, YuanYuan Zhu, Zhaoxia Li, Guohui Cui, Wenqi Tang, Wei Chen, Sogou, China |
Session | SPE-35: Speech Enhancement 5: DNS Challenge Task |
Location | Gather.Town |
Session Time: | Thursday, 10 June, 14:00 - 14:45 |
Presentation Time: | Thursday, 10 June, 14:00 - 14:45 |
Presentation |
Poster
|
Topic |
Speech Processing: [SPE-ENHA] Speech Enhancement and Separation |
IEEE Xplore Open Preview |
Click here to view in IEEE Xplore |
Virtual Presentation |
Click here to watch in the Virtual Conference |
Abstract |
Research on single channel speech enhancement (SE) has a long tradition, but two main practical problems still remain unsolved. First, high quality enhancement, computational efficiency and low-latency are hard to be satisfied simultaneously in the existing practical systems. Second, specific scenario enhancement, such as singing and emotional speech, is also a intricate problem for conventional methods. In this paper, we propose a computationally efficient real-time speech enhancement network with densely connected multi-stage structures, which progressively enhances the channels-wise subband speech. The enhancing speech from earlier stage is used to guide the processing of deeper stage in oder to obtain coarse to fine estimates. Besides, the supervision is applied to all intermediate results that stabilizes the training and accelerates the convergence. Moreover, a adaptive fine-tune step is utilized with some small datasets of specific scenarios, which achieves superb improvement under corresponding scenes. As a result, the proposed method achieves promising performance in terms of speech quality and demonstrates robustness in complex scenarios. |