SYSTEMS AND METHODS FOR TRAINING AND AUDITING AI SYSTEMS IN MACHINE LEARNING CONVERSATIONS

• Main Authors: Ferguson, Colin C, Webb-Purkis, William Dominic, Gainor, Macgregor S, Koepf, Werner, Harriger, James D, Jonnalagadda, Siddhartha Reddy, Terry, George Alexis
• Format: Patent
• Language: English
• Published: 18.07.2019
• Subjects: CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; HANDLING RECORD CARRIERS; PHYSICS; PRESENTATION OF DATA; RECOGNITION OF DATA; RECORD CARRIERS

Systems and methods for more effective AI operations, improvements to the experience of a conversation target, and increased productivity through AI assistance are provided. In some embodiments, the systems use machine learning models to classify a number of message responses with a confidence. If these classifications are below a threshold the messages are sent to a user for analysis, after prioritization, along with guidance data. Feedback from the user modified the models. In another embodiment, a system and method for an AI assistant is also provided which receives messages and determines instructions using keywords and/or classifications. The AI assistant then executes upon these instructions. In another embodiment, a conversation editor interface is provided. The conversation editor includes one or more displays that illustrate an overview flow diagram for the conversation, specific node analysis, libraries of conversations and potentially metrics that can help inform conversation flow. Lastly, task gamification may additionally be employed in order to increase the messaging system's performance.