Wednesday September 28, 2016

Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Google's Neural Machine Translation System

Google researchers released a paper today announcing the Google Neural Machine Translation, a complete learning system that was designed to eliminate the inherent weaknesses in traditional phrase-based systems used for machine translation.

Neural Machine Translation (NMT) is an end-to-end learning approach for automated translation, with the potential to overcome many of the weaknesses of conventional phrase-based translation systems. Unfortunately, NMT systems are known to be computationally expensive both in training and in translation inference. Also, most NMT systems have difficulty with rare words. These issues have hindered NMT's use in practical deployments and services, where both accuracy and speed are essential. In this work, we present GNMT, Google's Neural Machine Translation system, which attempts to address many of these issues. Our model consists of a deep LSTM network with 8 encoder and 8 decoder layers using attention and residual connections.