CFP last date
20 December 2024
Reseach Article

Optimization of LMS Algorithm for Adaptive Filtering using Global Optimization Techniques

by Shikha Tripathi, Mohammad Asif Ikbal
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 132 - Number 10
Year of Publication: 2015
Authors: Shikha Tripathi, Mohammad Asif Ikbal
10.5120/ijca2015907639

Shikha Tripathi, Mohammad Asif Ikbal . Optimization of LMS Algorithm for Adaptive Filtering using Global Optimization Techniques. International Journal of Computer Applications. 132, 10 ( December 2015), 36-42. DOI=10.5120/ijca2015907639

@article{ 10.5120/ijca2015907639,
author = { Shikha Tripathi, Mohammad Asif Ikbal },
title = { Optimization of LMS Algorithm for Adaptive Filtering using Global Optimization Techniques },
journal = { International Journal of Computer Applications },
issue_date = { December 2015 },
volume = { 132 },
number = { 10 },
month = { December },
year = { 2015 },
issn = { 0975-8887 },
pages = { 36-42 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume132/number10/23633-2015907639/ },
doi = { 10.5120/ijca2015907639 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2024-02-06T23:29:02.740929+05:30
%A Shikha Tripathi
%A Mohammad Asif Ikbal
%T Optimization of LMS Algorithm for Adaptive Filtering using Global Optimization Techniques
%J International Journal of Computer Applications
%@ 0975-8887
%V 132
%N 10
%P 36-42
%D 2015
%I Foundation of Computer Science (FCS), NY, USA
Abstract

Adaptive filtering is a growing area of research due to its vast no of application in many fields and its numerous advantages over non adaptive filters. In fact there are many areas where the use of adaptive filters is becoming mandatory. Few of them are System Identification, Inverse Modeling, Linear Prediction, Feedforward Control etc. although enough work has been carried out on adaptive filters, still there are many fields where we can make significant contribution .One is the developing adaptive filtering for systems which are having a multimodal error surface, like IIR filters as gradient based optimization techniques, which are used so far in the designing of these type of system get stuck to The multi-modal error surface of these system and causes the gradient based algorithms to be stuck at local minima and not converge to the global optimum, resulting in an unstable system. In this work, we have combined the advantages of both gradient based algorithm and global optimizations algorithm to make the adaptive filters capable of efficiently working for the system having multimodal error surface. In this new method we use LMS as gradient based algorithm and Ant Colony Optimization (ACO) & Particle swarm optimization (PSO) as global optimization algorithm. In which ACO take inspiration from the behavior of real ant colonies to solve this type of optimization problems and PSO is a population based stochastic optimization technique developed by Dr. Eberhart and Dr. Kennedy  in 1995, inspired by social behavior of bird flocking or fish schooling. The algorithm is implemented using MATLAB, and the simulation results obtained shows that the proposed approaches is quite efficient, accurate and has a fast convergence rate. The results obtained also demonstrate that the proposed method can be efficiently used in designing and identification of systems having multimodal error surface.

References
  1. Paulo S. R. Diniz, Adaptive Filtering Algorithms and Practical Implementations, Springer, USA, 2008.
  2. S. Haykin, Adaptive Filter Theory, Prentice Hall, USA, 2002.
  3. D. J. Krusienski, W. K. Jenkins, Design and performance of adaptive systems based on structured stochastic optimization strategies, IEEE Circuits Systems Magazine 5 (2005), pp. 8-20.
  4. S. C. Ng, S. H. Leung, C. Y. Chung, A. Luk, W. H. Lau, The genetic search approach: A new learning algorithm for adaptive IIR filtering, IEEE Signal Processing Magazine 13 (1996), pp. 38-46.
  5. N. Karaboga, Digital IIR filter design using differential evolution algorithm, EURASIP Journal on Applied Signal Processing 8 (2005), pp. 1-9.
  6. A. Kalinli, N. Karaboga, A parallel tabu search algorithm for digital filter design, COMPEL-The International Journal for Computation and Mathematics in Electrical and Electronic Engineering 24 (2005), pp. 1284-1298.
  7. N. Karaboga, B. Cetinkaya, Design of digital FIR filters using differential evolution algorithm, Circuits Systems and Signal Processing Journal 25 (2006) , pp. 649-660.
  8. https://www.scribd.com/doc/279933360/Optimized-Variable-Step-Size-Normalized-LMS-Adaptive-Algorithm-for-Echo-Cancellation. LMS Algorithm.
  9. D. J. Krusienski, W. K. Jenkins, Particle swarm optimization for adaptive IIR filter structures, Congress on Evolutionary Computation, 2004, pp. 965-970.
  10. A. Kalınlı, N. Karaboga, A new method for adaptive IIR filter design based on tabu search algorithm, International Journal of Electronics and Communication 59 (2004), pp. 1-7.
  11. S. Chen, B. L. Luk, Adaptive simulated annealing for optimization in signal processing applications, Signal Processing 79 (1999), pp. 117-128.
  12. N. Karaboga, A new design method based on artificial bee colony algorithm for digital IIR filters, Journal of the Franklin Institute-Engineering and Applied Mathematics 346 (2009), pp. 328-348.
  13. N. KARABOGA, A. KALINI, D. KARABOGA, Designing digital IIR filter using ant colony optimization algorithm. Engineering applications of artificial intelligence april 2004. Vol.17 (3)
  14. Dissanayake, S.D. Performance analysis of noise cancellation in a diversity combined ACO-OFDM system. ICTON, 2012
  15. P. S. R. Diniz, Adaptive Filtering: Algorithms and Practical Implementations, Kluwer Academic Publishers, Boston, 1997.
  16. P. S. R. Diniz, Adaptive Filtering: Algorithms and Practical Implementations, Kluwer Academic Publishers, Boston, 1997.
  17. Ioan Tabus, Stochastic gradient based adaptation: Least Mean Square (LMS)Algorithm, SGN 21006 Advanced Signal Processing:Lecture 5
  18. P. Visu and E. Kannan, Traffic Parameterized ACO for Ad-Hoc Routing
  19. Ali M. and Babak, A. “A new clustering algorithm based on hybrid global optimization based on a dynamical systems approach algorithm”, Expert Systems with Applications (Elsevier), Vol. 37,pp. 5645-5652, 2010
  20. Dorigo, M. and Stutzle, T. “Ant Colony Optimization”, MIT Press, Cambrige MA, 2004
  21. Dorigo, M., Maniezzo, V. and Colorni, A., “Ant System: Optimization by a colony of cooperating agents,” IEEE Transactions on Systems, Man, and Cybernetics—Part B, Vol. 26, No. 1, pp. 29 – 41, 1996
  22. Frank, N. and Carsten, W. “Ant Colony Optimization and the minimum spanning tree problem”, Theoretical Computer Science (Elsevier), Vol. 411, pp. 2406-2413, 2010
  23. Goss, Aron, Deneubourg, and Pasteels, “Selforganized shortcuts in the Argentine ant,” Naturwissenschaften, Vol. 76, pp. 579–581, 1989
  24. Hsin-Yun, L., Hao-Hsi, T., Meng-Cong, Z. and Pei-Ying, L. “Decision support for the maintenance management of green areas”, Expert Systems with Applications (Elsevier), Vol. 37, pp. 4479- 4487, 2010
  25. KwangMongSim and Weng Hong Sun, “Ant Colony Optimization for Routing and Load-Balancing: Survey and New Directions IEEE Transactions on Systems, Man, and Cybernetics—Part A: Systems And Humans”, Vol. 33, No. 5, 2003
  26. Li-Ning Xing, Ying-Wu Chen, Peng Wang, Qing-Song Zhao, JianXiong, “A Knowledge-Based Ant Colony Optimization for Flexible Job Shop Scheduling Problems”, Applied Soft Computing 10 (2010),pp. 888–896
Index Terms

Computer Science
Information Sciences

Keywords

IIR LMS Ant Colony Optimization Particle Swarm Optimization System Identification