The week's pick
Random Articles
Reseach Article
An Evolutionary Bayesian Network Learning Algorithm using Feature Subset Selection for Bayesian Network Classifiers
| International Journal of Computer Applications |
| Foundation of Computer Science (FCS), NY, USA |
| Volume 135 - Number 13 |
| Year of Publication: 2016 |
| Authors: Shefali K. Singhal |
10.5120/ijca2016908057
|
Shefali K. Singhal . An Evolutionary Bayesian Network Learning Algorithm using Feature Subset Selection for Bayesian Network Classifiers. International Journal of Computer Applications. 135, 13 ( February 2016), 1-8. DOI=10.5120/ijca2016908057
Abstract
Classification is the process of constructing (learning) a model (classifier) to predict the class (labels) for given data. Bayesian belief network classifiers allow the representation of dependencies between subsets of attributes of a dataset. But learning an optimal Bayesian belief network for a Bayesian network classifier is a NPhard problem. A number of heuristic-based algorithms have been proposed for supervised learning of bayesian belief network such as Tree-Augmented Naive Bayes (TAN), Hidden Naive Bayes (HNB). In the past decade, swarm intelligence (SI) based algorithms have been proposed for many optimization problems. Swarm intelligence based algorithms are characterized by the collective decentralized decision-making of several independent agents to search for the optimal solution in the solution search space. In this paper, we propose a hybrid swarm intelligence based Bayesian network classifier combining Hunting Group search with Feature subset selections. The Hunting Group Search - Feature Subset Selection (HuGS-FSS) algorithm has been inspired by the behaviour of a pack of hunting animals such as wolves. The classification accuracy of the proposed HuGSFSS algorithm is tested against other state of the art Bayesian network classifiers such as Naive Bayes, TAN, A2De, and HNB. Through comprehensive evaluation using 28 benchmark classification datasets from the UCI repository, we show that HuGS-FSS outperforms the other state of the art algorithms.
References
- Pablo Bermejo, Jos´e A G´amez, and Jos´e M Puerta. Speeding up incremental wrapper feature subset selection with naive bayes classifier. Knowledge-Based Systems, 55:140– 147, 2014.
- Jie Cheng and Russell Greiner. Comparing bayesian network classifiers. In Proceedings of the Fifteenth conference on Uncertainty in artificial intelligence, pages 101–108. Morgan Kaufmann Publishers Inc., 1999.
- David Maxwell Chickering. Learning bayesian networks is np-complete. In Learning from Data: Artificial Intelligence and Statistics V, pages 121–130. Springer-Verlag, 1996.
- Gregory F Cooper. The computational complexity of probabilistic inference using bayesian belief networks. Artificial intelligence, 42(2):393–405, 1990.
- Gregory F Cooper and Edward Herskovits. A bayesian method for the induction of probabilistic networks from data. Machine learning, 9(4):309–347, 1992.
- Erkan Do?gan and Ferhat Erdal. Hunting search algorithm based design optimization of steel cellular beams. In Proceeding of the fifteenth annual conference companion on Genetic and evolutionary computation conference companion, pages 1729–1730. ACM, 2013.
- Simon Fong, Kun Lan, and Raymond Wong. Classifying human voices by using hybrid sfx time-series preprocessing and ensemble feature selection. BioMed research international, 2013, 2013.
- Simon Fong, Xin-She Yang, and Suash Deb. Swarm search for feature selection in classification. In Computational Science and Engineering (CSE), 2013 IEEE 16th International Conference on, pages 902–909. IEEE, 2013.
- Nir Friedman, Dan Geiger, and Moises Goldszmidt. Bayesian network classifiers, 1997.
- Nir Friedman, Dan Geiger, and Moises Goldszmidt. Bayesian network classifiers. Machine learning, 29(2-3):131–163, 1997.
- Wu Husheng and Zhang Fengming. A uncultivated wolf pack algorithm for high-dimensional functions and its application in parameters optimization of pid controller. In Evolutionary Computation (CEC), 2014 IEEE Congress on, pages 1477– 1482, July 2014.
- Mark Hall Ian Witten, Eibe Frank. Data Mining: Practical Machine Learning Tools and Techniques.
- Liangxioa Jiang, Harry Zhang, and Zhihua Cai. A novel bayes model: Hidden naive bayes. IEEE Transactions on Knowledge and Data Engineering, 21(10), 2009.
- Fernando Jim´enez, Gracia S´anchez, and Jos´e M Ju´arez. Multi-objective evolutionary algorithms for fuzzy classification in survival prediction. Artificial intelligence in medicine, 60(3):197–219, 2014.
- M. Lichman. UCI machine learning repository, 2013.
- David Martens, Bart Baesens, and Tom Fawcett. Editorial survey: swarm intelligence for data mining. Machine Learning, 82(1):1–42, 2011.
- Luis Carlos Molina, Llu´is Belanche, and A` ngela Nebot. Feature selection algorithms: A survey and experimental evaluation. In Data Mining, 2002. ICDM 2003. Proceedings. 2002 IEEE International Conference on, pages 306–313. IEEE, 2002.
- Alberto Moraglio, Cecilia Di Chio, Julian Togelius, and Riccardo Poli. Geometric particle swarm optimization. Journal of Artificial Evolution and Applications, 2008:11, 2008.
- B Naderi, Majid Khalili, and Alireza Arshadi Khamseh. Mathematical models and a hunting search algorithm for the no-wait flowshop scheduling with parallel machines. International Journal of Production Research, 52(9):2667–2681, 2014.
- R. Oftadeh, M.J. Mahjoob, and M. Shariatpanahi. A novel meta-heuristic optimization algorithm inspired by group hunting of animals: Hunting search. Computers Mathematics with Applications, 60(7):2087 – 2098, 2010.
- Tang Rui, S. Fong, Xin-She Yang, and S. Deb. Natureinspired clustering algorithms for web intelligence data. In Web Intelligence and Intelligent Agent Technology (WI-IAT), 2012 IEEE/WIC/ACM International Conferences on, volume 3, pages 147–153, Dec 2012.
- Shefali K Singhal. Bio-inspired bayesian network learning algorithm for bayesian network classifiers. International Journal of Advance Engineering and Research Development, 2(3), 2015.
- Rui Tang, S. Fong, Xin-She Yang, and S. Deb. Wolf search algorithm with ephemeral memory. In Digital Information Management (ICDIM), 2012 Seventh International Conference on, pages 165–172, Aug 2012.
- Korakoch Waiyakan and Pongchanun Luangpaiboon. Heat treatment process optimization using hunting search and ant sense on path of steepest ascent. Applied Mechanics and Materials, 217:1475–1478, 2012.
- Geoffrey I. Webb, Janice R. Boughton, Fei Zheng, Kai Ming Ting, and Houssam Salem. Learning by extrapolation from marginal to full-multivariate probability distributions: Decreasingly naive bayesian classification. Machine Learning, 2012.
- Xin She Yang. Nature-Inspired Optimization Algorithms. Elsevier.
- Xin She Yang, Zhihua Cui, Renbin Xiao, Amir Hossein Gandomi, and Mehmet Karamanoglu. Swarm Intelligence and Bio-Inspired Computation. Elsevier, 2013.
- Kazem Zare and Sayyed Mohammad Hashemi. A solution to transmission-constrained unit commitment using hunting search algorithm. In Environment and Electrical Engineering (EEEIC), 2012 11th International Conference on, pages 941– 946. IEEE, 2012.
Index Terms
Keywords