Optimising the topology of complex neural networks
Fei Jiang, Hugues Berry and Marc Schoenauer
In: 3rd European Conference on Complex Systems, 1-5 Oct. 2007, Dresden, Germany.
In this paper, we study instances of complex neural networks, i.e. neural networks with complex topologies. We use Self-Organizing Map neural networks whose neighbourhood relationships are defined by a complex network, to classify handwritten digits. We show that topology has a small impact on performance and robustness to neuron failures, at least at long learning times. Performance may however be increased (by almost $10\%$) by artificial evolution of the network topology. In our experimental conditions, the evolved networks are more random than their parents, but display a more heterogeneous degree distribution.