AI-Based Syntactic Complexity Metrics and Sight Interpreting Performance

• Published in: Intelligent Human Computer Interaction Vol. 13184; pp. 534 - 547
• Main Authors: Zou, Longhui, Carl, Michael, Mirzapour, Mehdi, Jacquenet, Hélène, Vieira, Lucas Nunes
• Format: Book Chapter
• Language: English
• Published: Switzerland Springer International Publishing AG 2022; Springer International Publishing
• Series: Lecture Notes in Computer Science
• Subjects: AI and data; Cognitive interface design; Language and speech interfaces; Sight interpreting; Syntactic complexity; Translation assessment
• ISBN: 9783030984038; 3030984036
• ISSN: 0302-9743; 1611-3349
• DOI: 10.1007/978-3-030-98404-5_49

Complex syntax may lead to increased cognitive effort during translation. However, it is unclear what kinds of syntactic complexity have a stronger impact on translation performance. In this paper, we employ several syntactic metrics which enable us to explore the impact of syntactic complexity on the quality in English-to-Chinese sight interpreting. We have operationalized syntactic complexity by six metrics, namely, Incomplete Dependency Theory metric (IDT), Dependency Locality Theory metric (DLT), Combined IDT and DLT metric (IDT+DLT), Left Embeddedness metric (LE), Nested Nouns Distancemetric (NND), and Bilingual Complexity Ratio metric (BRC). Three professional translators have manually annotated translation errors using MQM-derived error taxonomies, which includes accuracy, fluency, and style errors, each as critical or minor errors. We assessed inter-rater agreement by adopting weighted Fleiss’ Kappa scores. We found that there are strong correlations between the IDT and IDT+DLT metrics and sight interpreting errors. We also found that language-specific syntactic differences between English and Chinese such as directions of branching and noun modifiers can have a strong influence on accuracy and critical errors.