Explainable analytics: understanding causes, correcting errors, and achieving increasingly perfect accuracy from the nature of distinguishable patterns

In addition to pursuing accurate analytics, it is invaluable to clarify how and why inaccuracy exists. We propose a transparent classification (TC) method. In training, data consist of positive and negative observations. To obtain positive patterns, we find the intersection between each of the two p...

Full description

Saved in:
Bibliographic Details
Published inScientific reports Vol. 12; no. 1; p. 18368
Main Authors Pai, Hao-Ting, Hsu, Chung-Chian
Format Journal Article
LanguageEnglish
Published England Nature Publishing Group 01.11.2022
Nature Publishing Group UK
Nature Portfolio
Subjects
Online AccessGet full text

Cover

Loading…
More Information
Summary:In addition to pursuing accurate analytics, it is invaluable to clarify how and why inaccuracy exists. We propose a transparent classification (TC) method. In training, data consist of positive and negative observations. To obtain positive patterns, we find the intersection between each of the two positive observations. The negative patterns are obtained in the same manner. Next, pure positive and pure negative patterns are established by selecting patterns that appear in only one type. In testing, such pure positive and pure negative patterns are used for scoring observations. Next, an observation is classified as positive if its positive score is not zero or if both its positive and negative scores are zero; otherwise, it is classified as negative. By experiment, TC can identify all positive (e.g., malignant) observations at low ratios of training to testing data, e.g., 1:9 using the Breast Cancer Wisconsin (Original) and 3:7 using the Contraceptive Method Choice. Without fine-tuned parameters and random selection, the uncertainty of the methodology is eliminated when using TC. TC can visualize causes, and therefore, prediction errors in a network are traceable and can be corrected. Furthermore, TC shows potential in identifying whether the ground truth is incorrect (e.g., identifying diagnostic errors).
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ISSN:2045-2322
2045-2322
DOI:10.1038/s41598-022-19650-2