Random Articles
Reseach Article
Modified Conjugate Gradient Method for Unconstrained Optimization
| International Journal of Computer Applications |
| Foundation of Computer Science (FCS), NY, USA |
| Volume 86 - Number 15 |
| Year of Publication: 2014 |
| Authors: Thamera K. Alkhashab |
10.5120/15065-3509
|
Thamera K. Alkhashab . Modified Conjugate Gradient Method for Unconstrained Optimization. International Journal of Computer Applications. 86, 15 ( January 2014), 42-46. DOI=10.5120/15065-3509
Abstract
Conjugate gradient method holds an important role in solving unconstrained Optimizations , especially for large scale problems. Numerous studies and modific ations have been done to improve this method . In this paper , we propose a new conjugate gradient meth od which is computed by modifying Dai and Yuan formula . This new formula for the denominator is introduced and the numerator of Dai and Yuan for mula is retrained , but still possesses global converge nce properties. Numerical results based on number of iterations and number of function evaluations by usin g exact line search have shown that the new formul a is an efficient when we comparative it with the oth er conjugate gradient methods.
References
- Al - Baali , M . (1985) . Descent Property and Global Convergence of Fletcher- Reeves Method with Inexact Line Search . IMA J . Numer . Anal. , 5, 121-124.
- Andrei, N. (2008). An Unconstrained Optimization Test Functions Collection. Advanced Modeling and Optimization, 10(1), 147-161.
- Andrei, N. (2009). Accelerated Conjugate Gradient algorithm with finite difference Hessian / vector product approximation for unconstrained optimization . J,Comput Appl. Math. 230,70-582
- Birgin, E. G. and Martinez. J. M. (2001). . A Spectral Conjugate Gradient Method for Unconstrained Optimization. J. Appl. Maths. Optim, 43,117-128.
- Dai, Y. and Yuan, Y. (1998) . Nonlinear Conjugate Gradient method . Shanghai Scientific and Technical Publishers, Beijing.
- Dai, Y. and Yuan, Y. (2000) . A Nonlinear Con-jugate Gradient with a Strong Global Convergence Properties. SIAM J. Optim. , 10, 177-182.
- Dai, Y. H. and Yuan, Y. (2002). A Note on The Nonlinear Conjugate Gradient Method. J,Comput. Appl. Math. , 18(6), 575-582.
- Dai, Y. H. , Han, J. Y. , Liu, G. H. , Sun, D. F. , Yin, X. and Yuan, Y. (1999). Convergence Properties of Properties of Nonlinear Conjugate Gradient Method. SIAM J. Optim. , 10, 348-358.
- Fletcher,R. and Reeves, C. (1964). Function Minimization by Conjugate Gradients. Comput. J. , 7, 149-154.
- Gilbert, J. C. and Nocedal, J. (1992). Global Convergence Properties of Conjugate Gradient Methods for optimization. SIAM J. Optim. , 2(1),21-42.
- Hager,W. W and Zhang, H. C. (2005). A New Conjugate Gradient Method with Guaranteed Descent and efficient line search. SIAM J. Optim. , 16, 170-192.
- Hestenes, M. R. and Steifel, E . (1952) . Method Of Conjugate Gradient for Solving Linear Equations. J,Res. Nat. Bur. Stand. , 49, 409-436.
- Liu,Y. and Storey, C. (1992). Efficient Generalized conjugate gradient algorithms part 1:theory. J,Comput. Appl. Math. , 69, 129-137.
- Mustafa Mamat , Mohd Rivaie , Islam Mohdand Muhammad Fauzi. (2010). A New Conjugate Gradient Coefficient for Unconstrained Optimization. Int. J. Contemp . Math . Sciences ,5(29),1429-1437.
- Polak , E. and , Ribiere, G. (1969). Note Sur La Convergence De Directions Conjugees. Rev. Francaise Informat Recherche Operationelle,3EAnnee(16), 35-43.
- Powell, M. J. D. (1986). Convergence Properties of Algorithm for Nonlinear Optimization. SIAM Review. , 28(4), 487-500.
- Rivaie. M , Fauzi. M, Mamat . M and Mohd . I . (2011). Modified Hestenes-Steifel Method forfor Unconstrained Optimization. J. Appl Sciences,11(8): DOI:10. 3923/jas. 2011. 1461-1464
- Shi, Z. J. and Gao, J. (2009). A New Family of,Conjugate Gradient Methods. J,Comput. Appl. Math. , 224, 444-457.
- Sun, J. and Zhang, J. (2001). Global Convergence of Conjugate Gradient Methods without Line Search. Annals. Opr. Rch, 103, 161-173.
- Touati-Ahmed, D. and Storey, C . (1990). Efficient Hybrid Conjugate Gradient Techniques, J. Optim. Theory Appl. , 64, 379-397.
- Wolfe, P. (1969) . Convergence Conditions for Ascent Method. SIAM Rev. ,11,226-235.
- Yuan, G and Wei, Z. (2009). New Line Search Methods for Unconstrained Optimization . J. Korean Stat. Soc. , 38, 29-39.
- Yuan, Y. and Sun,W. (1999). Theory and Methods of optimization. Science Press of China,Beijing.
- Zoutendijk, G. (1970). Nonlinear ProgrammingComputational Methods. In : Abadie J. (Ed. )Integer and nonlinear programming, 37-86. Received: November, 2009
Index Terms
Keywords