The week's pick
Random Articles
Reseach Article
Analysis of Hopfield Associative Memory with Combination of MC Adaptation Rule and an Evolutionary Algorithm
| International Journal of Computer Applications |
| Foundation of Computer Science (FCS), NY, USA |
| Volume 78 - Number 11 |
| Year of Publication: 2013 |
| Authors: Amit Singh, Somesh Kumar, T P Singh |
10.5120/13536-1275
|
Amit Singh, Somesh Kumar, T P Singh . Analysis of Hopfield Associative Memory with Combination of MC Adaptation Rule and an Evolutionary Algorithm. International Journal of Computer Applications. 78, 11 ( September 2013), 37-42. DOI=10.5120/13536-1275
Abstract
The combination of evolutionary algorithms and ANN has been a recent interest in the field of research. Hopfield model is a type of recurrent neural network which has been widely studied for the purpose of associative memories. In the present work, this Hopfield Model of feedback neural networks has been studied with Monte Carlo adaptation learning rule and one evolutionary searching algorithm i. e. genetic algorithm for pattern association. The aim is to obtain the optimal weight matrices with the MC-adaptation rule and Genetic algorithm for efficient recalling of any approximate input patterns. The experiments consider the Hopfield neural networks architectures that store all objects using Monte Carlo-adaptation rule and simulates the recalling of these stored patterns on presentation of prototype input patterns using evolutionary algorithm (Genetic Algorithm). Experiment shows the recalling of patterns using genetic algorithm have better results than the conventional recalling with Hebbian rule.
References
- Simpson P K, "Foundations of Neural Networks", Artificial Neural Networks: Paradigms, Applications and Hardware Implementations (E. Sanchez-Sinencio and C. Lau, eds. ), New York: IEEE Press, pp. 3-24, 1992.
- Anderson J A, Rosenfeld E, "Neurocomputing: Foundations of Research" MIT Press, Boston, MA, 1988.
- Hinton G E, Sejnowski T J, "Neural Network Architectures for AI", Tutorial Number MP2, National Conference on Artificial Intelligence (AAAI-87), July 1987.
- Jain A K, Robert P W D, Mao J, "Statistical Pattern Recognition: A Review", IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, number 1, pp. 4-33, 2000.
- Grenander U, General Pattern Theory, Oxford University Press, 1993.
- Schalkoft R, Pattern Recognition- Statistical, structural and neural approaches, John Wiley & Sons, 1992.
- Kosko, B. , "Neural Networks and Fuzzy Systems" Prentice-Hall India, 2005.
- Yao X, "Evolving Artificial Neural Network", Proceedings of the IEEE, vol. 87, number 9, September 1999.
- Moller M F, "A scale conjugate gradient algorithm for supervised learning", Neural Networks, vol 6, number 4, pp 525-533, 1993.
- Chauvin Y and Rumelhart D E, Eds. , Backpropagation: Theory, Architectures, and Applications, Hillsdale, NJ: Erlbaum, 1995.
- Sutton R S, "Two problems with back propagation and other steepest-descent learning procedures for networks", in Proceedings of 8th Annual Conference of Cognitive Science Society, Hillsdale, NJ: Erbaum, pp. 823 – 831, 1986.
- Bremermann H J, "The Evolution of Intelligence: The Nervous System as a Model of its Environment", Technical Report No. 1, Contract No. 477(17), Department of Mathematics, University of Washigton, Seattle, 1958.
- Hopfield J J, "Neurons with graded response have collective computational properties like those of two state neurons", Proceedings of National Academy of Sciences, vol. 81, pp. 3088-3092, 1984.
- Hopfield J J, Tank D W, "Computing with neural circuits: A model", Science, vol. 233, pp625-633, 1986.
- Shapiro J L, "Theoretical aspects of evolutionary computing", Statistical Mechanics Theory of Genetic Algorithms, Natural Computing (Springer-Verlag, London, UK), pp. 87-108, 2001.
- Koza J R and Rice J P, "Genetic generation of both the weights and architecture for a neural network", in Proceedings of IEEE Int. Joint Conf. Neural Networks (IJCNN'91 Seattle), vol. 2, pp. 397-404, 1991.
- Wright S, "The evolution of life", Panel discussion in Evolution After Darwin: Issues in Evolution, vol III, S Tax and C Callender, Eds. Chicago: University of Chicago Press, 1960.
- Bäck T, Hammel U, Schwefel H P, "Evolutionary Computation: Comments on the History and Current State", IEEE Trans. Evolutionary Computation, vol. 1, pp 3-17, April 1997.
- Schaffer J D, Whiltley D and Eshelman, "Combination of genetic algorithm and neural network: The state of the art", IEEE Computer Society, 1992.
- Zhou Zen and Zhao Hong, Improvement in Hopfield Neural Network by MC-adaptation rule, department of physics,Xiamen 2006.
- Zhou Zen and Zhao Hong, Improvement in Hopfield Neural Network by MC-adaptation rule, department of physics,Xiamen 2006
- A. Imada and K. Araki, (1997) Applications of an Evolutionary Strategy to the Hopfield Model of Associative Memory, in: Proceedings of the IEEE international conference on evolutionary computation, pp. 679-683.
- Yan W, Zhu Z, and Hu R, "Hybrid genetic/BP algorithm and its application for radar target classification", in Proc. 1997 IEEE National Aerospace and Electronics Conf. , NAECON. Part 2 (of 2), pp. 981-984, 1997.
Index Terms
Keywords