The effect of the temperature parameter on convergence in the Boltzmann machines
Boltzmann machines show attractive features in traditional neural network tasks. We tested the robustness of the Boltzmann machine in a non-linear mapping task. The system's errors were classified into several categories and the distribution of errors between the categories was studied. Using s...
Saved in:
Published in | Proceedings of 19th Convention of Electrical and Electronics Engineers in Israel pp. 200 - 203 |
---|---|
Main Authors | , , |
Format | Conference Proceeding |
Language | English |
Published |
IEEE
1996
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Summary: | Boltzmann machines show attractive features in traditional neural network tasks. We tested the robustness of the Boltzmann machine in a non-linear mapping task. The system's errors were classified into several categories and the distribution of errors between the categories was studied. Using simulations, it is demonstrated that limitation of the temperature parameter causes the distribution of the network's errors to be unique and different from its usual error distribution. The phenomenon receives a mathematical explanation rooted in the statistical mechanics basics of the Boltzmann machine. This has applications in designing and evaluating mapping tasks for the Boltzmann machines and can help speed up system convergence, which is known to be a major deficit of the Boltzmann machine. |
---|---|
ISBN: | 9780780333307 0780333306 |
DOI: | 10.1109/EEIS.1996.566929 |