On neural network design. Part II : Inhibition and the output map

• Published in: Circuits, systems, and signal processing Vol. 17; no. 5; pp. 613 - 635
• Main Authors: PORTER, W. A, ABOUALI, A. H
• Format: Journal Article
• Language: English
• Published: Heidelberg Springer 01.09.1998; Springer Nature B.V
• Subjects: Applied sciences; Electric, optical and optoelectronic circuits; Electronics; Exact sciences and technology; Neural networks; Perceptron; Codebook; Linear combination; Circuit design; Vector quantization; Linear regression; Network architecture; Information extraction; Performance analysis; Neural network; Equalization
• ISSN: 0278-081X; 1531-5878
• DOI: 10.1007/BF01203108

In this two part study, we presented a new design methodology for neural classifiers. The design procedure utilizes a multiclass vector quantization, MVQ, algorithm for information extraction from the training set. The extracted information suffices to specify the hidden layer in a canonical neural network architecture. The extracted information also leads to the specification of neuron inhibition rules and subsequently to the design of the hidden layer to output map. In part I of that study, we focused attention on the MVQ algorithm and how it is used to extract information from a training set. The extracted information is used to directly specify the hidden layer. In part II, we consider the non-simplistic hidden layer to output map design. We note that the MVQ algorithm, as it extracts information, decomposes the design set into disjoint neighborhoods. For each neighborhood we identify subsets of the hidden layer neurons which are significant sensors for the neighborhood. For each subset we construct an output map. Inhibition rules are established to assure that the proper output map is activated. In benchmark simulations, the overall design exhibits performance, to the extent that we are hard pressed to identify bounds on performance, if any.[PUBLICATION ABSTRACT]