Development of the “VoiceTra” Multi-Lingual Speech Translation System

This study introduces large-scale field experiments of VoiceTra, which is the world's first speech-to-speech multilingual translation application for smart phones. In the study, approximately 10 million input utterances were collected since the experiments commenced. The usage of collected data...

Full description

Saved in:
Bibliographic Details
Published inIEICE Transactions on Information and Systems Vol. E100.D; no. 4; pp. 621 - 632
Main Authors MATSUDA, Shigeki, HAYASHI, Teruaki, ASHIKARI, Yutaka, SHIGA, Yoshinori, KASHIOKA, Hidenori, YASUDA, Keiji, OKUMA, Hideo, UCHIYAMA, Masao, SUMITA, Eiichiro, KAWAI, Hisashi, NAKAMURA, Satoshi
Format Journal Article
LanguageEnglish
Published Tokyo The Institute of Electronics, Information and Communication Engineers 01.01.2017
Japan Science and Technology Agency
Subjects
Automatic speech recognition
Communications systems
Language modeling
Language usage
Machine translation
Multilingualism
Smartphones
Speech recognition
Speech synthesis
speech translation
statistical machine translation
Upgrading
Voice recognition
Online AccessGet full text

Cover

More Information
Summary:This study introduces large-scale field experiments of VoiceTra, which is the world's first speech-to-speech multilingual translation application for smart phones. In the study, approximately 10 million input utterances were collected since the experiments commenced. The usage of collected data was analyzed and discussed. The study has several important contributions. First, it explains system configuration, communication protocol between clients and servers, and details of multilingual automatic speech recognition, multilingual machine translation, and multilingual speech synthesis subsystems. Second, it demonstrates the effects of mid-term system updates using collected data to improve an acoustic model, a language model, and a dictionary. Third, it analyzes system usage.
ISSN:0916-8532
1745-1361
DOI:10.1587/transinf.2016AWI0006