CFP last date
20 January 2025
Reseach Article

An Exponential Kernel based Fuzzy Rough Sets Model for Feature Selection

by Riaj Uddin Mazumder, Shahin Ara Begum, Devajyoti Biswas
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 81 - Number 6
Year of Publication: 2013
Authors: Riaj Uddin Mazumder, Shahin Ara Begum, Devajyoti Biswas
10.5120/14016-2155

Riaj Uddin Mazumder, Shahin Ara Begum, Devajyoti Biswas . An Exponential Kernel based Fuzzy Rough Sets Model for Feature Selection. International Journal of Computer Applications. 81, 6 ( November 2013), 24-31. DOI=10.5120/14016-2155

@article{ 10.5120/14016-2155,
author = { Riaj Uddin Mazumder, Shahin Ara Begum, Devajyoti Biswas },
title = { An Exponential Kernel based Fuzzy Rough Sets Model for Feature Selection },
journal = { International Journal of Computer Applications },
issue_date = { November 2013 },
volume = { 81 },
number = { 6 },
month = { November },
year = { 2013 },
issn = { 0975-8887 },
pages = { 24-31 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume81/number6/14016-2155/ },
doi = { 10.5120/14016-2155 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2024-02-06T21:55:22.287642+05:30
%A Riaj Uddin Mazumder
%A Shahin Ara Begum
%A Devajyoti Biswas
%T An Exponential Kernel based Fuzzy Rough Sets Model for Feature Selection
%J International Journal of Computer Applications
%@ 0975-8887
%V 81
%N 6
%P 24-31
%D 2013
%I Foundation of Computer Science (FCS), NY, USA
Abstract

Feature subset selection is a data preprocessing step for pattern recognition, machine learning and data mining. In real world applications an excess amount of features present in the training data may result in significantly slowing down of the learning process and may increase the risk of the learning classifier to over fit redundant features. Fuzzy rough set plays a prominent role in dealing with imprecision and uncertainty. Some problem domains have motivated the hybridization of fuzzy rough sets with kernel methods. In this paper, the Exponential kernel is integrated with the fuzzy rough sets approach and an Exponential kernel approximation based fuzzy rough set method is presented for feature subset selection. Algorithms for feature ranking and reduction based on fuzzy dependency and exponential kernel functions are presented. The performance of the Exponential kernel approximation based fuzzy rough set is compared with the Gaussian kernel approximation and the neighborhood rough sets for feature subset selection. Experimental results demonstrate the effectiveness of the Exponential kernel based fuzzy rough sets approach for feature selection in improving the classification accuracy in comparison to Gaussian kernel approximation and neighborhood rough sets approach.

References
  1. Vapnik, V. 1995. The Nature of Statistical Learning Theory. Springer, New York.
  2. Cristianini, N. , Shawe-Taylor, J. 2000. An Introduction to Support Vector Machines and other Kernel-based Learning Methods. Cambridge University Press, Cambridge.
  3. Shawe-Taylor, J. , Cristianini, N. 2004. Kernel Methods for Pattern Analysis. Cambridge University Press.
  4. Pawlak, Z. 1982. Rough sets, Int. J. Inform. Comput. Sci. 11: 314–356.
  5. Pawlak, Z. 1991. Rough Sets – Theoretical Aspects of Reasoning about Data, Kluwer Academic Publishers, Dordrecht.
  6. Dubois, D. and Prade, H. 1990. Rough fuzzy sets and fuzzy rough sets, Int. J. General Syst. 17 (2–3) : 191–209.
  7. Wu,W. and Zhang, W. 2004. Constructive and axiomatic approaches of fuzzy approximation operators, Inf. Sci. 159 (3–4) : 233–254.
  8. Yeung, D. S. , Chen, D. , Tsang, E. C. C. , Lee, J. W. T. and Wang, X. Z. 2005. On the generalization of fuzzy rough sets, IEEE Trans. On Fuzzy Systems 13 (3) 343–361.
  9. Moser, B. 2006. On the t-transitivity of kernels, Fuzzy Sets Syst. 157 :787–1796.
  10. Moser, B. 2006. On representing and generating kernels by fuzzy equivalence relations, J. Mach. Learn. Res. 7 : 2603–2620.
  11. Morsi , N. N. and Yakout,M. M. 1998. Axiomatics for fuzzy rough set, Fuzzy Sets Syst. 100 : 327–342.
  12. D. Dubois and H. Prade, 1992. Putting rough sets and fuzzy sets together, Intelligent Decision Support, Kluwer Academic Publishers, Dordrecht, 203–232.
  13. P. Lingras and R. Jensen. 2007. "Survey of Rough and Fuzzy Hybridization", IEEE Intl. Conf. on Fuzzy Systems, 1-6.
  14. Genton, M. 2001. Classes of kernels for machine learning: A statistics perspective, Journal of Machine Learning Research, 2: 299–312.
  15. Hu, Q. H. , Yu, D. R. and Xie, Z. X. 2006. Information-preserving hybrid data reduction based on fuzzy-rough techniques, Pattern Recognition Lett. 27 (5) : 414–423.
  16. Yu, D. , Hu, Q. H. and Wu, C. 2007. Uncertainty measures for fuzzy relations and their applications, Appl. Soft Comput. 7 : 1135–1143.
  17. Jensen, R. and Shen, Q. 2004. Semantics-Preserving Dimensionality Reduction: Rough and Fuzzy-Rough-Based Approaches, IEEE Trans. On Know. and Data Engg. 16(12) : 1457–1471.
  18. Jensen, R. and Shen, Q. 2009. New approaches to fuzzy-rough feature selection, IEEE Trans. Fuzzy Syst. 17: 824–828.
  19. Hu, Q. , Yu, D. and Xie, Z. 2008. Neighborhood classifiers, Expert Syst. Appl. 34 : 866–876.
  20. Robnik-Sikonja, M. and Kononenko, I. 2003. Theoretical and empirical analysis of ReliefF and RReliefF, Mach. Learning 53 : 23–69.
  21. Hu, Q. , Yu, D. , Liu, J. and Wu, C. 2008. Neighborhood rough set based heterogeneous feature subset selection. Inf. Sciences 178 3577–3594.
  22. Blake ,C. Merz, C. , Hettich, S. and Newman, D. J. 1998. UCI repository of machine learning databases, University of California, School of Information and Computer Sciences, Irvine, CA.
  23. Brieman, L. , Friedman, J. , Stone, C. J. and Olshen, R. A. 1984. Classi_cation and Regression Trees, Chapman and Hill.
  24. Yan, R. 2006. A MATLAB Package for Classification Algorithm.
  25. Sun, Y. 2006. Iterative RELIEF for feature weighting: algorithms, theories and applications, IEEE Trans. Pattern Analysis and Machine Intelligence 1-27.
  26. Atkeson, C. G. Moore, A. W. and Schaal, S. 1997. Locally weighted learning, Artificial Intelligence Review, 11(15) : 11-73.
  27. Hu, Q. , Zhang, L. , Chen, D. , Pedrycz, W. and Yu, D. 2010. Gaussian kernel based fuzzy rough sets: Model, uncertainty measures and applications, Intl. Journl. of Approx. Reasoning 51 : 453-471.
  28. Lin, T. Y. 2001. Granulation and nearest neighborhoods: rough set approach. In: Pedrycz, W. (ed. ) Granular computing: an emerging paradigm, pp. 125–142, Physica-Verlag, Heidelberg.
Index Terms

Computer Science
Information Sciences

Keywords

Rough set Fuzzy rough set Exponential kernel Feature selection