The week's pick
Random Articles
Reseach Article
A Novel Approach for Feature Selection based on the Bee Colony Optimization
| International Journal of Computer Applications |
| Foundation of Computer Science (FCS), NY, USA |
| Volume 43 - Number 8 |
| Year of Publication: 2012 |
| Authors: Rana Forsati, Alireza Moayedikia, Andisheh Keikha |
10.5120/6122-8329
|
Rana Forsati, Alireza Moayedikia, Andisheh Keikha . A Novel Approach for Feature Selection based on the Bee Colony Optimization. International Journal of Computer Applications. 43, 8 ( April 2012), 13-16. DOI=10.5120/6122-8329
Abstract
One of the successful methods in classification problems is feature selection. Feature selection algorithms; try to classify an instance with lower dimension, instead of huge number of required features, with higher and acceptable accuracy. In fact an instance may contain useless features which might result to misclassification. An appropriate feature selection methods tries to increase the effect of significant features while ignores insignificant subset of features. In this work feature selection is formulated as an optimization problem and a novel feature selection procedure in order to achieve to a better classification results is proposed. Experiments over a standard benchmark demonstrate that applying Bee Colony Optimization in the context of feature selection is a feasible approach and improves the classification results.
References
- E. Gasca, J. S. Sanchez, R. Alonso, Eliminating redundancy and irrelevance using a new MLP-based feature selection method, Pattern Recognition 39 (2006) 313–315.
- P. Pudil, J. Novovicova, J. Kittler, Floating search methods in feature selection, Pattern Recognition Letters 15 (11) (1994) 1119–1125.
- R. Setiono, H. Liu, Neural network feature selector, IEEE Transactions on Neural Networks vol. 8 (1997).
- A. Verikas, M. Bacauskiene, Feature selection with neural networks, Pattern Recognition Letters 23 (2002) 1323–1335.
- I. Guyon, A. Elisseeff, An introduction to variable and feature selection, Journal of Machine Learning Research 3 (2003) 1157–1182.
- H. Liu, Lei Tu, Toward integrating feature selection algorithms for classification and clustering, IEEE Transactions on Knowledge and Data Engineering 17 (4) (2005) 491–502.
- M. Das, H. Liu, Feature selection for clustering, Proceedings of Pacific-asia Conference on Knowledge Discovery and Data Mining (2000) 110–121.
- M. A. Hall, Correlation-based feature selection for discrete and numeric class machine learning, in: Proceedings of the 17th International Conference on Machine Learning, 2000.
- Y. Lei, H. Liu, Feature selection for high-dimensional data: a fast correlation- based filter solution, in: Proceedings of the 20th International Conference on Machine Learning (ICML), 2003.
- K. Michalak, H. Kwasnicka, Correlation-based feature selection strategy in neural classification, in: Proceedings of the 6th International Conference on Intelligent Systems Design and Applications (ISDA), 2006.
- X. Wang, J. Yang, X. Teng, W. Xia, R. Jensen, Feature selection based on rough sets and particle swarm optimization, Pattern Recognition Letters 28 (2007) 459–471.
- C. Hsu, H. Huang, D. Schuschel, The ANNIGMA- wrapper approach to fast feature selection for neural nets, IEEE Transactions on Systems Man, and Cybernetics—Part B:Cybernetics32(2)(2002)207–212.
- J. Huang, Y. Cai, X. Xu, A hybrid genetic algorithm for feature selection wrapper based on mutual information, Pattern Recognition Letters 28 (2007) 1825–1844.
- R. K. Sivagaminathan, S. Ramakrishnan, A hybrid approach for feature subset selection using neural networks and ant colony optimization, Expert Systems with Applications 33 (2007) 49–60.
- H. Zhang, G. Sun, Feature selection using Tabu search method, Pattern Recognition 35 (2002) 701-711.
- D. A. Bell, H. Wang, A formalism for relevance and its application in feature subset selection, Machine Learning 41 (2004) 175–195.
- E. Parzen, ARARMA models for time series analysis and forecasting, Journal of Forecasting 1 (1982) 67–87.
- A. A. Albrecht, Stochastic local search for the feature set problem, with applications to microarray data, Applied Mathematics and Computation 183 (2006) 1148–1164.
- S. F. Cotter, K. Kreutz-Delgado, B. D. Rao, Backward sequential elimination for sparse vector selection, Signal Processing 81 (2001) 1849–1864.
- P. Lucic, D. Teodorovic, Bee System: Modeling combinatorial optimization transportation engineering problems by swarm intelligence. In preprints of the TRISTAN IV Triennial symposium on Transportation Analysis. Sao Miguel, Azores Island, ( 2001) 441-445.
- P. Lucic, D. Teodorovic, Transportation modeling: an artificial approach. In proceedings of the 14th IEEE International Conference on Tools with Artificial intelligence. Washington DC, (2002) 216-223.
- R. Diao, Q. Shen, Two New Approaches to Feature Selection with Harmony Search, WCCI 2010 IEEE World Congress on Computational Intelligence, 2010, Spain.
- P. Murphy, D. Aha, UCI repository of machine learning databases, 1995, URL http://www. sgi. com/Technology/mlc/db.
- J. Wroblewski, Finding minimal reducts using genetic algorithm, Proceedings of the second annual join conference on information science, (1995) 186–189.
- R. Forsati, A. Moayedikia, B. Safarkhani, Heuristic approach to solve feature selection problem, DICTAP, 2011, pp. 707-717.
- R. Forsati, M. Shamsfard, P. Mojtahedpour, An efficient meta heuristic algorithm for pos-tagging, Fifth International Multi-Conference on Computing in the Global Information Technology (ICCGI, pp. 93-98, 20-25, 2010.
- R. Forsati, M. Mahdavi, M. Kangavari, B. Safarkhani, Web page clustering using Harmony Search optimization, Canadian Conference on Electrical and Computer Engineering, CCECE 2008, , pp. 001601-001604, 2008.
Index Terms
Keywords