An intelligent error correction model for English grammar with hybrid attention mechanism and RNN algorithm

Abstract

This article proposes an English grammar intelligent error correction model based on the attention mechanism and Recurrent Neural Network (RNN) algorithm. It aims to improve the accuracy and effectiveness of error correction by combining the powerful context-capturing ability of the attention mechanism with the sequential modeling ability of RNN. First, based on the improvement of recurrent neural networks, a bidirectional gated recurrent network is added to form a dual encoder structure. The encoder is responsible for reading and understanding the input text, while the decoder is responsible for generating the corrected text. Second, the attention mechanism is introduced into the decoder to convert the output of the encoder into the attention probability distribution for integration. This allows the model to focus on the relevant input word as it generates each corrected word. The results of the study showed that the model was 2.35% points higher than statistical machine translation–neural machine translation in the CoNLL-2014 test set, and only 1.24 points lower than the human assessment score, almost close to the human assessment level. The model proposed in this study not only created a new way of English grammar error correction based on the attention mechanism and RNN algorithm in theory but also effectively improved the accuracy and efficiency of English grammar error correction in practice. It further provides English learners with higher-quality intelligent error correction tools, which can help them learn and improve their English level more effectively.

Keywords

• attention mechanism
• recurrent neural network
• transformer
• english grammar error correction