Supporting Analysis of Dimensionality Reduction Results with Contrastive Learning

• Published in: IEEE transactions on visualization and computer graphics Vol. 26; no. 1; pp. 45 - 55
• Main Authors: Fujiwara, Takanori, Kwon, Oh-Hyun, Ma, Kwan-Liu
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.01.2020; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Clustering; contrastive learning; Data visualization; Dimensionality reduction; Feature extraction; high-dimensional data; Identification methods; Interactive systems; Methods; Principal component analysis; Principal components analysis; Reduction; Task analysis; Visual analytics
• ISSN: 1077-2626; 1941-0506
• DOI: 10.1109/TVCG.2019.2934251

Dimensionality reduction (DR) is frequently used for analyzing and visualizing high-dimensional data as it provides a good first glance of the data. However, to interpret the DR result for gaining useful insights from the data, it would take additional analysis effort such as identifying clusters and understanding their characteristics. While there are many automatic methods (e.g., density-based clustering methods) to identify clusters, effective methods for understanding a cluster's characteristics are still lacking. A cluster can be mostly characterized by its distribution of feature values. Reviewing the original feature values is not a straightforward task when the number of features is large. To address this challenge, we present a visual analytics method that effectively highlights the essential features of a cluster in a DR result. To extract the essential features, we introduce an enhanced usage of contrastive principal component analysis (cPCA). Our method, called ccPCA (contrasting clusters in PCA), can calculate each feature's relative contribution to the contrast between one cluster and other clusters. With ccPCA, we have created an interactive system including a scalable visualization of clusters' feature contributions. We demonstrate the effectiveness of our method and system with case studies using several publicly available datasets.