The week's pick
Reseach Article
Feature Subset Selection Problem using Wrapper Approach in Supervised Learning
| International Journal of Computer Applications |
| Foundation of Computer Science (FCS), NY, USA |
| Volume 1 - Number 7 |
| Year of Publication: 2010 |
| Authors: Asha Gowda Karegowda, M.A.Jayaram, A.S. Manjunath |
10.5120/169-295
|
Asha Gowda Karegowda, M.A.Jayaram, A.S. Manjunath . Feature Subset Selection Problem using Wrapper Approach in Supervised Learning. International Journal of Computer Applications. 1, 7 ( February 2010), 13-17. DOI=10.5120/169-295
Abstract
Feature subset selection is of immense importance in the field of data mining. The increased dimensionality of data makes testing and training of general classification method difficult. Mining on the reduced set of attributes reduces computation time and also helps to make the patterns easier to understand. In this paper a wrapper approach for feature selection is proposed. As a part of feature selection step we used wrapper approach with Genetic algorithm as random search technique for subset generation ,wrapped with different classifiers/ induction algorithm namely decision tree C4.5, NaïveBayes, Bayes networks and Radial basis function as subset evaluating mechanism on four standard datasets namely Pima Indians Diabetes Dataset, Breast Cancer, Heart Stat log and Wisconsin Breast Cancer. Further the relevant attributes identified by proposed wrapper are validated using classifiers. Experimental results illustrate, employing feature subset selection using proposed wrapper approach has enhanced classification accuracy.
References
- Asha Gowda Karegowda and M.A. Jayaram, March 6-7, 2009. Cascading GA & CFS for Feature Subset Selection in Medical Data Mining. International Conference on IEEE International Advance Computing Conference (IACC’09), Thapar University, Patiala, Punjab India.
- D. Goldberg .1989. Genetic Algorithms in Search, Optimization, and Machine learning, Addison Wesley,
- I. H. Witten, E. Frank. 2005. Data Mining: Practical machine learning tools and techniques. 2nd Edition, Morgan Kaufmann, San Francisco.
- J. Han And M. Kamber. 2001. Data Mining: Concepts and Techniques. San Francisco, Morgan Kauffmann Publishers.
- Jennifer G. Dy. 2004. Feature Selection for Unsupervised Learning, Journal of Machine Learning, pp845-889.
- M.A.Jayaram, Asha Gowda Karegowda.2007. Integrating Decision Tree and ANN for Categorization of Diabetics Data. International Conference on Computer Aided Engineering, December 13-15, 2007, IIT Madras, Chennai, India.
- Mark A. Hall ,Correlation-based Feature Selection for Machine Learning, Dept of Computer science, University of Waikato .http://www.cs.waikato.ac.nz/ mhall/thesis.pdf
- Manoranjan Dash, Kiseiok Choi, Petr Scheuermann, Huan Liu. 2002. Feature Selection for Clustering – a Filter Solution. In Proceedings of the Second International Conference on Data Mining.
- M. Dash 1, H. Liu2. March 1997. Feature Selection for Classification, Intelligent Data Analysis 1 (131–156, www.elsevier.com/locate/ida]
- Ron Kohavi, George H. John.1997. Wrappers for feature subset Selection, Artificial Intelligence, Vol. 97, No. 1-2. pp. 273-324.
- Shyamala Doraisamy ,Shahram Golzari ,Noris Mohd. Norowi, Md. Nasir B Sulaiman , Nur Izura Udzir. 2008. A Study on Feature Selection and ClassificationTechniques for Automatic Genre Classification of Traditional Malay Music. ismir2008.ismir.net/papers/ISMIR2008 256.pdf(2008).
- Volfer Rotz, and Tilman Lange. 2003. Feature Selection in Clustering Problems”, In Advances in Neural Information Processing Systems 16.
- Y.Saeys, I.Inza, and P. LarrANNaga,. 2007. A review of feature selection techniquesin bioinformatics, Bioinformatics, 23(19),, pp.2507-2517.
Index Terms
Keywords