TCB Publications - Abstract
K.-R. Müller, M. Finke, N. Murata, K. Schulten, and S. Amari. Large scale simulations for learning curves. In Jong-Hoon Oh, Chulan Kwon, and Sungzoon Cho, editors, Progress in neural Processing Vol. 1 / Neural Networks: The Statistical Mechanics Perspective, pp. 73-84. World Scientific, Singapore, 1995.
are studied in large scale simulations using a CM5. Small stochastic feed-forward networks trained with back-propagation and conjugate gradient descent are investigated. In the range of a large number of training patterns t, the predicted asymptotic 1/t scaling is observed. For a medium range t a faster scaling in the number of training patterns t than 1/t is observed. This effect is explained by using higher order corrections of the likelihood expansion. For small t it is shown, that the scaling law changes drastically, when the network undergoes a transition from permutation symmetric to permutation symmetry broken phase. This effect is related to previous theoretical work
. Download Full Text
The manuscripts available on our site are provided for your personal use only and may not be retransmitted or redistributed without written permissions from the paper's publisher and author. You may not upload any of this site's material to any public server, on-line service, network, or bulletin board without prior written permission from the publisher and author. You may not make copies for any commercial purpose. Reproduction or storage of materials retrieved from this web site is subject to the U.S. Copyright Act of 1976, Title 17 U.S.C.
