Efficient bilingual lexicon extraction from comparable corpora based on formal concepts analysis

• Published in: Natural language engineering Vol. 29; no. 1; pp. 138 - 161
• Main Authors: Chebel, Mohamed, Latiri, Chiraz, Gaussier, Eric
• Format: Journal Article
• Language: English
• Published: Cambridge, UK Cambridge University Press 01.01.2023; Cambridge University Press (CUP)
• Subjects: Bilingual dictionaries; Bilingualism; Clustering; Computer Science; Computerized corpora; Dictionaries; Document and Text Processing; Humanities and Social Sciences; Hypotheses; Information retrieval; Linguistics; Multilingualism; Natural language processing; Parallel corpora; Semantics; Sparsity; Evaluation; Information retrieval; Information extraction; Corpus linguistics; Multilinguality; Corpus linguistics, Evaluation, Information extraction, Information retrieval, Multilinguality
• ISSN: 1351-3249; 1469-8110
• DOI: 10.1017/S135132492100022X

Bilingual corpora are an essential resource used to cross the language barrier in multilingual natural language processing tasks. Among bilingual corpora, comparable corpora have been the subject of many studies as they are both frequent and easily available. In this paper, we propose to make use of formal concept analysis to first construct concept vectors which can be used to enhance comparable corpora through clustering techniques. We then show how one can extract bilingual lexicons of improved quality from these enhanced corpora. We finally show that the bilingual lexicons obtained can complement existing bilingual dictionaries and improve cross-language information retrieval systems.