ENHANCED LOGITS FOR NATURAL LANGUAGE PROCESSING

• Main Authors: Hong, Yu-Heng, Vishnoi, Vishal, Hoang, Cong Duy Vu, Vu, Thanh Tien, Dharmasiri, Yakupitiyage Don Thanuja Samodhye, Parekh, Manish, Zaremoodi, Poorya, Duong, Thanh Long, Johnson, Mark Edward, Blinov, Vladislav, Xu, Ying, Jalaluddin, Elias Luqman
• Format: Patent
• Language: English
• Published: 11.07.2024
• Subjects: CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; ELECTRIC COMMUNICATION TECHNIQUE; ELECTRIC DIGITAL DATA PROCESSING; ELECTRICITY; PHYSICS; TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHICCOMMUNICATION

Techniques for using enhanced logit values for classifying utterances and messages input to chatbot systems in natural language processing. A method can include a chatbot system receiving an utterance generated by a user interacting with the chatbot system and inputting the utterance into a machine-learning model including a series of network layers. A final network layer of the series of network layers can include a logit function. The machine-learning model can map a first probability for a resolvable class to a first logit value using the logit function. The machine-learning model can map a second probability for a unresolvable class to an enhanced logit value. The method can also include the chatbot system classifying the utterance as the resolvable class or the unresolvable class based on the first logit value and the enhanced logit value.