The week's pick
Reseach Article
Hybrid Supervised Learning in MLP using Real-coded GA and Back-propagation
| International Journal of Computer Applications |
| Foundation of Computer Science (FCS), NY, USA |
| Volume 62 - Number 21 |
| Year of Publication: 2013 |
| Authors: P. P. Sarangi, B. S. P. Mishra, B. Majhi, S. Dehuri |
10.5120/10222-5006
|
P. P. Sarangi, B. S. P. Mishra, B. Majhi, S. Dehuri . Hybrid Supervised Learning in MLP using Real-coded GA and Back-propagation. International Journal of Computer Applications. 62, 21 ( January 2013), 32-39. DOI=10.5120/10222-5006
Abstract
This paper addresses a classification task of pattern recognition by combining effectiveness of evolutionary and gradient descent techniques. We are proposing a hybrid supervised learning approach using real-coded GA and back-propagation to optimize the connection weights of multilayer perceptron. The following learning algorithm overcomes the problems and drawbacks of individual technique by introducing global and local adaptation strategies. The behavior of the proposed algorithm is observed by the experimental results on a couple of popular benchmark datasets. The results of our algorithm are compared with training algorithms based on conventional back-propagation and real-coded genetic algorithm. Finally we realize that proposed hybrid learning algorithm outperforms back-propagation and real-coded genetic algorithm based training the multilayer perceptron.
References
- P. P. Sarangi, B. Majhi and M. Panda, "Performance Analysis of Neural Networks Training using Real Coded Genetic Algorithm", International Journal of Computer Applications 51(18):30-36, 2012.
- H. HasanÖrkcü, HasanBal, "Comparing performances of back-propagation and genetic algorithms in the data classification", Expert Systems with Applications, Volume 38, Issue 4,Pages 3703-3709,2011.
- Zhang, G. , "Neural networks for classification: a survey", IEEE Transactions on Systems, Man, and Cybernetics, Part C 30(4): 451-462, 2000.
- S. B. Kotsiantis, "Supervised Machine Learning: A Review of Classification Techniques", Informatica31 249-268, 2007
- L. Davis, "Mapping Classifier Systems into Neural Networks'', Conference on Neural Information Processing Systems, Morgan Kaufimann, 1988.
- Whitley, Darrell, "Applying Genetic Algorithms to Neural Network Problems," International Neural Network Society p. 230, 1988.
- Randall S. Sexton, Robert E. Dorsey, John D. Johnson, "Optimization of Neural Networks: A Comparative Analysis of the Genetic Algorithm and Simulated Annealing", European Journal of Operational Research, volume 114, issue 3,page 589-601, 1999.
- Gupta, J. N. D. , & Sexton, R. S. Comparing back-propagation with a genetic algorithm for neural network training. Omega, 27, 679–684.
- X. Yao, Evolving artificial neural networks, Proc. IEEE 87 (9), 1423–1447, 1999.
- Pal S. K. and BhandariD. "Selection Of optimal set of weights in a layered network using genetic algorithm", Information Sciences, Vol: 80, Pages: 213-234,1994.
- D. E. Rumelhart, G. E. Hinton, R. J. Williams, Learning representations by back-propagating errors, Nature 323 533-536, 1986
- Simon Haykin, "Neural Networks: A comprehensive foundation," Pearson Education Asia, Seventh Indian Reprint, 2004.
- J. H. Holland, Adaptation in Natural and Artificial Systems, the University of Michigan Press, 1975.
- D. E. Goldberg, Genetic Algorithms in Search, Optimization, and Machine Learning, Addison-Wesley, New York, 1989.
- F. Herrera, M. Lozano, J. L. Verdegay, Tackling Real-coded Genetic Algorithms: Operators and Tools for Behavioral Analysis, Artificial Intelligence Review 12: 265-319, Kluwer Academic Publishers 1998.
- Whitley, Darrell, Starkweather, Timothy, and Christopher Bogart, "Genetic Algorithms and Neural Networks: Optimizing Connections and Connectivity," ParallelComputing, 14, pp. 347-361,1990.
- Deep, K. , & Thakur, M. A new crossover operator for real coded genetic algorithms. Applied Mathematics and Computation, 188, 895–911, 2007.
- Prechelt, L. : Proben1, "A Set of Neural Network Benchmark Problems and Benchmarking Rules". Technical Report 21, FakultÄat fÄur Informatik UniversitÄat Karlsruhe, 76128 Karlsruhe, Germany, 1994.
- Schaffer J. D. , D. Whitley, and L. J. Eshelman, "Combinations of Genetic Algorithms and Neural Networks: A Survey of the State of the Art," Proceedings of the IEEE Workshop on Combinations of Genetic Algorithms and Neural Network.
- UCI repository of machine learning databases, Department of Information and Computer Sciences, University of California, Irvine, http://www. ics. uci. edu/~mlearn/MLRepositor.
Index Terms
Keywords