A MODIFIED ERROR BACKPROPAGATION ALGORITHM FOR COMPLEX-VALUE NEURAL NETWORKS
Abstract
The complex-valued backpropagation algorithm has been widely used in fields of dealing with telecommunications, speech recognition and image processing with Fourier transformation. However, the local minima problem usually occurs in the process of learning. To solve this problem and to speed up the learning process, we propose a modified error function by adding a term to the conventional error function, which is corresponding to the hidden layer error. The simulation results show that the proposed algorithm is capable of preventing the learning from sticking into the local minima and of speeding up the learning.
References
- IEEE Trans. on Signal Processing 40, 967 (1992). Crossref, ISI, Google Scholar
- IEEE Trans. on Circuits. Syst-II: Analog Digital Signal Processing 39, 330 (1992). Crossref, ISI, Google Scholar
M. S. Kim and C. C. Guest , Modification of backpropagation networks for complex-valued signal processing in frequency domain, Proc. Internat. Joint Conf. Neural Networks3 (1990) pp. 27–31. Google Scholar- Trans. of Information Processing Society of Japan 32, 1319 (1991). Google Scholar
- Neural Networks 10, 1391 (1997). Crossref, Medline, ISI, Google Scholar
- Neural Networks 16, 1101 (2003). Crossref, Medline, ISI, Google Scholar
A. Von Lehmen , Factors influencing learning by backpropagation, Proc. IEEE Int. Conf. Neural NetworksI (1988) pp. 335–341. Google ScholarC. B. Owen and A. M. Abunawass , Application of simulated annealing to the backpropagation model improves convergence, Proc. SPICE Conf. Science of Artifical Neural NetworksII (1993) pp. 269–276. Google Scholar- IEEE Trans. on Neural Networks 10, 1511 (1999). Crossref, Medline, ISI, Google Scholar
- A. Hadjiprocopis, Feed forward neural network entities, Ph.D. thesis, Department of Computer Science, City University, UK (2000) . Google Scholar
G. Goerick and W. V. Seelen , On unlearnable problems or a model for premature saturation in backpropagation learning, Proc. of the European Symposium on Artifical Neural Networks (1996) pp. 13–18. Google Scholar-
S. Haykin , Neural Networks a Comprehensive Foundation ( Macmillan Publishing , New York , 1994 ) . Google Scholar - Neurocomputing 57, 477 (2004). Crossref, ISI, Google Scholar
- Mathematics of Control, Signals, and Systems 2, 303 (1989). Crossref, Google Scholar
- J. VLSI Signal Processing Systems for Signal, Image, and Video Technology 32, 29 (2002). Crossref, ISI, Google Scholar
- Neural Computation 15, 1641 (2003). Crossref, Medline, ISI, Google Scholar



