On the evolutionary weighting of neighbours and features in the k-nearest neighbour rule

This paper presents an evolutionary method for modifying the behaviour of the k-Nearest-Neighbour classifier (kNN) called Simultaneous Weighting of Attributes and Neighbours (SWAN). Unlike other weighting methods, SWAN presents the ability of adjusting the contribution of the neighbours and the sign...

Full description

Saved in:
Bibliographic Details
Published inNeurocomputing (Amsterdam) Vol. 326-327; pp. 54 - 60
Main Authors Mateos-García, Daniel, García-Gutiérrez, Jorge, Riquelme-Santos, José C.
Format Journal Article
LanguageEnglish
Published Elsevier B.V 31.01.2019
Subjects
Evolutionary computation
Feature weighting
Neighbours weighting
Neighbours weighting
Evolutionary computation
Feature weighting
Online AccessGet full text

Cover

More Information
Summary:This paper presents an evolutionary method for modifying the behaviour of the k-Nearest-Neighbour classifier (kNN) called Simultaneous Weighting of Attributes and Neighbours (SWAN). Unlike other weighting methods, SWAN presents the ability of adjusting the contribution of the neighbours and the significance of the features of the data. The optimization process focuses on the search of two real-valued vectors. One of them represents the votes of neighbours, and the other one represents the weight of each feature. The synergy between the two sets of weights found in the optimization process helps to improve significantly, the classification accuracy. The results on 35 datasets from the UCI repository suggest that SWAN statistically outperforms the other weighted kNN methods.
ISSN:0925-2312
1872-8286
DOI:10.1016/j.neucom.2016.08.159