Complementary neural networks for regression problems

• Published in: 2009 International Conference on Machine Learning and Cybernetics Vol. 6; pp. 3442 - 3447
• Main Authors: Kraipeerapun, P., Nakkrasae, S., Amornsamankul, S., Chun Che Fung
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.07.2009
• Subjects: Cybernetics; Machine learning; Neural networks
• ISBN: 9781424437023; 1424437024
• ISSN: 2160-133X
• DOI: 10.1109/ICMLC.2009.5212716

In this paper, complementary neural networks (CMTNN) are used to solve the regression problem. CMTNN consist of a pair of opposite neural networks. The first neural network is trained to predict degree of truth values and the second neural network is trained to predict degree of falsity values. Both neural networks are complementary to each other since they deal with pairs of complementary output values. In order to predict the more accurate outputs, each pair of the truth and falsity values are aggregated based on two techniques which are equal weight combination and dynamic weight combination. The first technique is just a simple averaging whereas the second technique deals with errors occurred in the prediction. We experiment our approach to the classical benchmark problems including housing, concrete compressive strength, and computer hardware from the UCI machine learning repository. It is found that complementary neural networks improve the prediction performance as compared to the traditional single backpropagation neural network and support vector regression used to predict only truth values. Furthermore, the difference between the predicted truth value and the complement of the predicted falsity value can be used as an uncertainty indicator to support the confidence in the prediction of unknown input data.