On the parallelization of artificial neural networks and genetic algorithms

Abstract

Simulating an ANN or a genetic algorithm on a parallel processing system one can use several techniques. This paper presents two methods on implementing parallel simulations of Artificial Neural Networks (ANNs) on Transputer Based Systems, using the C programming language under Helios O.S. and Component Distribution Language (CDL) or, alternatively, the 3L Parallel C language. The Processor Farm topology is used for the parallel implementation of Back-Propagation and Multi-Layered Feed-Forward ANNs. A transputer system was also used to implement a simulation of an island parallel genetic algorithm (PGA) and a new optimization method based on PGAs. The method, called Co-operating Populations with Different Evolution Behaviours (CoPDEB), is independent of the machine architecture. It allows the populations to exhibit different evolution behaviours by using a variety of selection mechanisms, operators, communication methods, and parameters as explained in the sequel.