The Feature Selection Method Based on a Probabilistic Approach and a Cross-Entropy Metric for the Image Recognition Problem

This paper considers the problem of feature selection in the classification problem. A method for selecting informative features based on a probabilistic approach and cross-entropy metrics is proposed. Several variants of the information criterion for selecting features for a binary classification p...

Full description

Saved in:
Bibliographic Details
Published inScientific and technical information processing Vol. 48; no. 6; pp. 430 - 435
Main Author Dubnov, Yu. A.
Format Journal Article
LanguageEnglish
Published Moscow Pleiades Publishing 01.12.2021
Springer Nature B.V
Subjects
Classification
Computer Science
Computer Systems Organization and Communication Networks
Entropy
Feature selection
Object recognition
classification
feature selection
cross-entropy
Online AccessGet full text

Cover

More Information
Summary:This paper considers the problem of feature selection in the classification problem. A method for selecting informative features based on a probabilistic approach and cross-entropy metrics is proposed. Several variants of the information criterion for selecting features for a binary classification problem are considered, as well as its generalization to the case of a multiclass problem. Demonstration examples of the proposed method for the task of image recognition from the mnist collection are given.
ISSN:0147-6882
1934-8118
DOI:10.3103/S0147688221060022