Implementation of A Neural Natural Language Understanding Component for Arabic Dialogue Systems

Natural Language Understanding (NLU) is considered a core component in implementing dialogue systems. NLU has been greatly enhanced by deep learning techniques such as word embeddings and deep neural network architectures, but current NLP methods for Arabic language dialogue action classification or...

Full description

Saved in:
Bibliographic Details
Published inProcedia computer science Vol. 142; pp. 222 - 229
Main Authors Bashir, Abdallah M., Hassan, Abubakr, Rosman, Benjamin, Duma, Daniel, Ahmed, Mohanad
Format Journal Article
LanguageEnglish
Published Elsevier B.V 2018
Subjects
Arabic
Dialogue Systems
Named Entity Recognition
Natural language understanding
NLP
Semantic Decoding
Text Classification
Named Entity Recognition
NLP
Arabic
Dialogue Systems
Text Classification
Semantic Decoding
Natural language understanding
Online AccessGet full text

Cover

More Information
Summary:Natural Language Understanding (NLU) is considered a core component in implementing dialogue systems. NLU has been greatly enhanced by deep learning techniques such as word embeddings and deep neural network architectures, but current NLP methods for Arabic language dialogue action classification or semantic decoding is mostly based on handcrafted rule-based systems and methods that use feature engineering, but without the benefit of any form of distributed representation of words. This paper presents an approach to use deep learning techniques for text classification and Named Entity Recognition for the domain of home automation in Arabic. To this end, we present an NLU module that can further be integrated with Automatic Speech Recognition (ASR), a Dialogue Manager (DM) and a Natural Language Generator (NLG) module to build a fully working dialogue system. The paper further describes our process of collecting and annotating the data, structuring the intent classifier and entity extractor models, and finally the evaluation of these methods on different benchmarks.
ISSN:1877-0509
1877-0509
DOI:10.1016/j.procs.2018.10.479