Detecting and reducing bias (including discrimination) in an automated decision making process

• Main Authors: Silberman, Gabriel M, Belanger, Jean, Bennet, Karen, Roberts, Michael Louis
• Format: Patent
• Language: English
• Published: 05.03.2024
• Subjects: CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FORADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORYOR FORECASTING PURPOSES; ELECTRIC DIGITAL DATA PROCESSING; PHYSICS; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE,COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTINGPURPOSES, NOT OTHERWISE PROVIDED FOR

In some implementations, a computing device determines an event timeline that comprises one or more finance-related events associated with a person. A production classifier may be used to determine (i) an individual contribution of each event in the event timeline to a financial capacity of the person and (ii) a first decision regarding whether to extend credit to the person. A bias monitoring classifier may, based on the event timeline, determine a second decision whether to extend credit to the person. The bias monitoring classifier may be trained using pseudo-unbiased data. If a difference between the first decision and the second decision satisfies a threshold, the production classifier may be modified to reduce bias in decisions made by the production classifier.