The week's pick
Random Articles
Reseach Article
An Overview of Inductive Learning Algorithms
| International Journal of Computer Applications |
| Foundation of Computer Science (FCS), NY, USA |
| Volume 88 - Number 4 |
| Year of Publication: 2014 |
| Authors: Amal M. Almana, Mehmet Sabih Aksoy |
10.5120/15340-3675
|
Amal M. Almana, Mehmet Sabih Aksoy . An Overview of Inductive Learning Algorithms. International Journal of Computer Applications. 88, 4 ( February 2014), 20-28. DOI=10.5120/15340-3675
Abstract
Inductive learning enables the system to recognize patterns and regularities in previous knowledge or training data and extract the general rules from them. In literature there are proposed two main categories of inductive learning methods and techniques. Divide-and-Conquer algorithms also called decision Tree algorithms and Separate-and-Conquer algorithms known as covering algorithms. This paper first briefly describe the concept of decision trees followed by a review of the well known existing decision tree algorithms including description of ID3, C4. 5 and CART algorithms. A well known example of covering algorithms is RULe Extraction System (RULES) family. An up to date overview of RULES algorithms, and Rule Extractor-1 algorithm, their solidity as well as shortage are explained and discussed. Finally few application domains of inductive learning are presented.
References
- H. A. ELGIBREEN and M. S. AKSOY, "RULES – TL?: A SIMPLE AND IMPROVED RULES," J. Theor. Appl. Inf. Technol. , vol. 47, no. 1, 2013.
- A. H. Mohamed and M. H. S. Bin Jahabar, "Implementation and Comparison of Inductive Learning Algorithms on Timetabling," Int. J. Inf. Technol. , vol. 12, no. 7, pp. 97–113, 2006.
- A. Trnka, "Classification and Regression Trees as a Part of Data Mining in Six Sigma Methodology," Proc. World Congr. Eng. Comput. Sci. , vol. I, 2010.
- M. R. ?; Tolun and S. M. Abu-Soud, "An Inductive Learning Algorithm for Production Rule Discovery," Department of Computer Engineering Middle East Technical University. Ankara, Turkey, pp. 1–19, 2007.
- J. S. Deogun, V. V Raghavan, A. Sarkar, and H. Sever, "Data Mining?: Research Trends , Challenges , and Applications," in in in Roughs Sets and Data Mining: Analysis of Imprecise Data, Kluwer Academic Publishers, 1997, pp. 9–45.
- M. ?; S. A. Holsheimer, "Data Mining - The Search for Knowledge in Databases," Amsterdam, The Netherlands, 1991.
- lan H. Witten and E. Frank, Data Mining: Practical Machine Learning Tools and Techniques, 2nd editio. Morgan Kaufmann, 2005.
- A. Bahety, "Extension and Evaluation of ID3 – Decision Tree Algorithm. " University of Maryland, College Park, pp. 1–8.
- F. Stahl, M. Bramer, and M. Adda, "PMCRI?: A Parallel Modular Classification Rule Induction Framework," in in Machine Learning and Data Mining in Pattern Recognition, Springer Berlin Heidelberg, 2009, pp. 148–162.
- L. A. Kurgan, K. J. Cios, and S. Dick, "Highly scalable and robust rule learner: performance evaluation and comparison. ," IEEE Trans. Syst. Man. Cybern. B. Cybern. , vol. 36, no. 1, pp. 32–53, Feb. 2006.
- T. M. Mitchell, "Decision Tree Learning," in in Machine Learning, Singapore: McGraw- Hill, 1997, pp. 52–80.
- B. K. Baradwaj and P. Saurabh, "Mining Educational Data to Analyze Students' Performance," Int. J. Adv. Comput. Sci. Appl. , vol. 2, no. 6, pp. 63–69, 2011.
- A. Rathee and R. prakash Mathur, "Survey on Decision Tree Classification algorithms for the Evaluation of Student Performance," Int. J. Comput. Technol. , vol. 4, no. 2, pp. 244–247, 2013.
- R. Bhardwaj and S. Vatta, "Implementation of ID3 Algorithm," Int. J. Adv. Res. Comput. Sci. Softw. Eng. , vol. 3, no. 6, pp. 845–851, 2013.
- L. Breiman, J. H. Friedman, R. A. Olshen, and C. J. Stone, "Classification and regression trees," vol. 57, no. 1. Monterey, Calif. :Wadsworth and Brooks, Feb-1984.
- T. Verma, S. Raj, M. A. Khan, and P. Modi, "Literacy Rate Analysis," Int. J. Sci. Eng. Res. , vol. 3, no. 7, pp. 1–4, 2012.
- S. K. Yadav and S. Pal, "Data Mining?: A Prediction for Performance Improvement of Engineering Students using Classification," World Comput. Sci. Inf. Technol. J. , vol. 2, no. 2, pp. 51–56, 2012.
- X. Wu, V. Kumar, J. R. Quinlan, J. Ghosh, Q. Yang, H. Motoda, G. J. McLachlan, A. Ng, B. Liu, P. S. Yu, Z. -H. Zhou, M. Steinbach, D. J. Hand, and D. Steinberg, "Top 10 algorithms in data mining," Knowl. Inf. Syst. , Spriger, vol. 14, no. 1, pp. 1–37, Dec. 2007.
- D. T. Pham and M. S. Aksoy, "RULES: A simple rule extraction system," Expert Syst. Appl. , vol. 8, no. 1, pp. 59–65, Jan. 1995.
- M. S. Aksoy, "A Review of RULES Family of Algorithms," Math. Comput. Appl. , vol. 13, no. 1, pp. 51–60, 2008.
- M. S. Aksoy, H. Mathkour, and B. A. Alasoos, "Performance evaluation of rules-3 induction system on data mining," Int. J. Innov. Comput. Inf. Control, vol. 6, no. 8, pp. 1–8, 2010.
- D. T. Pham and S. S. Dimov, "AN EFFICIENT ALGORITHM FOR AUTOMATIC KNOWLEDGE ACQUISITION," Pattern Recognit. , vol. 30, no. 7, pp. 1137–1143, 1997.
- D. T. Pham and S. S. Dimov, "An algorithm for incremental inductive learning," Proc. Inst. Mech. Eng. Part B J. Eng. Manuf. , vol. 211, no. 3, pp. 239–249, Jan. 1997.
- D. T. Pham, S. Bigot, and S. S. Dimov, "RULES-5: a rule induction algorithm for classification problems involving continuous attributes," Proc. Inst. Mech. Eng. Part C J. Mech. Eng. Sci. , vol. 217, no. 12, pp. 1273–1286, Jan. 2003.
- D. T. Pham and a. a. Afify, "RULES-6: a simple rule induction algorithm for supporting decision making," 31st Annu. Conf. IEEE Ind. Electron. Soc. 2005. IECON 2005. , p. 6 pp. , 2005.
- H. I. Mathkour, "RULES3-EXT IMPROVEMENTS ON RULES-3 INDUCTION ALGORITHM," Math. Comput. Appl. , vol. 15, no. 3, pp. 318–324, 2010.
- K. Shehzad, "EDISC: A Class-Tailored Discretization Technique for Rule-Based Classification," IEEE Trans. Knowl. Data Eng. , vol. 24, no. 8, pp. 1435–1447, Aug. 2012.
- D. T. Pham, "A Novel Rule Induction Algorithm with Improved Handling of Continuous Valued Attributes," Cardiff University, 2012.
- Ö. Akgöbek, Y. S. Aydin, E. Öztemel, and M. S. Aksoy, "A new algorithm for automatic knowledge acquisition in inductive learning," Knowledge-Based Syst. , vol. 19, no. 6, pp. 388–395, Oct. 2006.
- M. S. Aksoy, A. Almudimigh, O. Torkul, and I. H. Cedimoglu, "Applications of Inductive Learning to Automated Visual Inspection," Int. J. Comput. Appl. , vol. 60, no. 14, pp. 14–18, 2012.
- N. Rajadhyax and R. Shirwaikar, "Data Mining on Educational Domain. " pp. 1–6, 2010.
- D. A. Alhammadi and M. S. Aksoy, "Data Mining in Education- An Experimental Study," Int. J. Comput. Appl. , vol. 62, no. 15, pp. 31–34, 2013.
- R. Quinlan, "C4 . 5?: Programs for Machine Learning," vol. 240. Kluwer Academic Publishers, Kluwer Academic Publishers, Boston. Manufactured in The Netherlands. , pp. 235–240, 1994.
- P. LANGLEY and H. A. Simon, "Applications of Machine Learning and Rule Induction," Palo Alto, CA, 1995.
Index Terms
Keywords