CCE-Net: Causal Convolution Embedding Network for Streaming Automatic Speech Recognition

Abstract

Streaming Automatic Speech Recognition (ASR) has gained significant attention across various application scenarios, including video conferencing, live sports events, and intelligent terminals. However, chunk division for current streaming speech recognition results in insufficient contextual information, thus weakening the ability of attention modeling and leading to a decrease in recognition accuracy. For Mandarin speech recognition, there is also a risk of splitting Chinese character phonemes into different chunks, which may lead to incorrect recognition of Chinese characters at chunk boundaries due to incomplete phonemes. To alleviate these problems, we propose a novel front-end network - Causal Convolution Embedding Network (CCE-Net). The network introduces a causal convolution embedding module to obtain richer historical context information, while capturing Chinese character phoneme information at chunk boundaries and feeding it to the current chunk. We conducted experiments on Aishell-1 and Aidatatang. The results showed that our method achieves a character error rate (CER) of 5.07% and 4.90%, respectively, without introducing any additional latency, showing competitive performances.

Source and licence. Open-access article originally published as “CCE-Net: Causal Convolution Embedding Network for Streaming Automatic Speech Recognition” in International Journal of Network Dynamics and Intelligence, 2024. DOI: 10.53941/ijndi.2024.100019. © Feiteng Deng, Yue Ming, Boyang Lyu. Reproduced unchanged under the Creative Commons Attribution 4.0 licence.