Neural Network Acceptability Judgments

• Published in: Transactions of the Association for Computational Linguistics Vol. 7; pp. 625 - 641
• Main Authors: Warstadt, Alex, Singh, Amanpreet, Bowman, Samuel R.
• Format: Journal Article
• Language: English
• Published: One Rogers Street, Cambridge, MA 02142-1209, USA MIT Press 01.11.2019; MIT Press Journals, The; The MIT Press
• Subjects: Acceptability; Artificial neural networks; Boolean; Classification; English language; Error analysis; Grammar; Human performance; Linguistic competence; Linguistics; Neural networks; Recurrent neural networks; Reproducibility; Sentences; Syntax

This paper investigates the ability of artificial neural networks to judge the grammatical acceptability of a sentence, with the goal of testing their linguistic competence. We introduce the Corpus of Linguistic Acceptability (CoLA), a set of 10,657 English sentences labeled as grammatical or ungram...