Random Articles
Reseach Article
An Expert System for Automated Essay Scoring (AES) in Computing using Shallow NLP Techniques for Inferencing
| International Journal of Computer Applications |
| Foundation of Computer Science (FCS), NY, USA |
| Volume 51 - Number 10 |
| Year of Publication: 2012 |
| Authors: Abejide Olu Ade-ibijola, Ibiba Wakama, Juliet Chioma Amadi |
10.5120/8080-1480
|
Abejide Olu Ade-ibijola, Ibiba Wakama, Juliet Chioma Amadi . An Expert System for Automated Essay Scoring (AES) in Computing using Shallow NLP Techniques for Inferencing. International Journal of Computer Applications. 51, 10 ( August 2012), 37-45. DOI=10.5120/8080-1480
Abstract
In this paper, we present the report of the development of an Expert System (ES) that; acquires the knowledge of Subject Matter Experts (SMEs) in a specific computing field, "Software Engineering", uses a built-in Inference Engine designed with Shallow Natural Language Processing Techniques (Information Extraction using Tokenization, Statistical Keyword Analysis and Domain-Specific Dictionary) and a Fuzzy-Scoring Model to assess Students' Free-Text Answers to Open-Ended Questions and hence, computes the correctness of students' answers with respect to lecturers' underlying model answers or templates. The newly developed ES was adapted to an academic course in the University System and its performance was evaluated using certain Statistical Metrics. The results from the evaluation were compared with existing Automated Essay Scoring Systems (AESs) using certain thresholds and conclusions were drawn.
References
- Abney S. 1996 . "Part-of-speech tagging and partial parsing". Dordrecht: Kluwer. Ade-Ibijola et. al.
- Akinyokun O. C. 2002 , "Neuro-Fuzzy Expert System for Evaluation of Human Resource Performance". First Bank Endowment Fund Lecture delivered at the Federal University of Technology, Akure.
- Attali, Y. , & Powers D. 2008 , "Effect of immediate feedback and revision on psychometric properties of open-ended GRE Subject Test items" GRE Board Research Rep. No GRE-04-05). Princeton, NJ: ETS.
- Bethune . D, Kelly . T, and Liversidge . T. 2007 , "SCHOLAR Study Guide SQA Higher Information Systems, Unit 3a: Expert Systems. www. torry. aberdeen. sch. uk/departs/comp/hinfosys3a. pdf
- Bereiter, C. 2003 , "Automated essay scoring: a cross disciplinary approach". In Mark D. Shermis and Jill C. Burstein Eds. , Foreword (pp. vii- ix), Lawrence Erlbaum Associates: Mahwah, NJ.
- Bloom, B. S. 1956 , "Taxonomy of educational objectives: The classification of educational goals". Handbook I, Cognitive domain. New York, Toronto: Longmans, Green.
- Burstein J. , Leacock C. , and Swartz R. 2001 , "Automated evaluation of essays and short answers. In Proceedings of the 5th International CAA Conference.
- Chakraborty R. C. 2010 , Expert Systems: AI Course Lecture 35-36 Notes. http://www. myreaders. info/07_Expert_Systems. pdf
- Kiong S. W. , Latif A. B. Rahman A, Mohd F. Z. and Azwan A. A. , 2005 . published on www. generation5. org/content/2005/expert_system. asp
- Marcu D. 2000 , "The theory and practice of discourse parsing and summarization" The MIT Press.
- Mcgrath P. 2003 , "Assessing Students: Computer Simulation vs MCQs". In Proceedings of the 7thComputer Assisted Assessment Conference, 2003.
- Mitchell T. , Russell T. , Broomhead P. , and Aldridge N. 2002 , "Towards robust computerised marking of free-text responses". In Proceedings of the 6th Computer Assisted Assessment Conference, 2002.
- Mitchell T. , Aldridge N. , Williamson W. , and Broomhead P. 2003 , "Computer based testing of medial knowledge. In Proceedings of the 7th Computer Assisted Assessment Conference, 2003.
- Moser J. R. 2009 , "The Electronic Assessor: Design and Prototype of an Automated Free-Text Assessment System". A Master's Thesis at Institute for Information Systems and Computer Media (IICM), Graz University of Technology, A-8010 Graz, Austria.
- Page, E. B. 2003 , "Project Essay Grade: PEG. In M. D. Shermis & J. Burstein (Eds. ). Automated essay scoring: A cross-disciplinary perspective. Mahwah, NJ: Lawrence Erlbaum Associates
- Palmer K. and Richardson P. 2003 , "On-line assessment and free-response input - a pedagogic and technical model for squaring the circle". In Proceedings of the 7th Computer Assisted Assessment Conference, 2003.
- Perez D. 2007 , "Adaptive Computer Assisted Assessment of Free-text students' answers: an approach to automatically generate students' conceptual models. PhD Thesis, Computer Science Department, Universidad Aut´onoma de Madrid, 2007.
- . Perez D. , Gliozzo A. , Strapparava C. , Alfonseca E. , Rodr´?guez P. and Magnini B. 2005 , "Automatic Assessment of Students free-text Answers underpinned by the Combination of a BLEU-inspired algorithm and Latent Semantic Analysis". Published by the American Association for Artificial Intelligence (AAAI) Press. Presented at the 18th International Conference of the Florida Artificial Intelligence Society (FLAIRS), U. S. A. , May 2005.
- Rudner, L. M. & Liang, T. 2002 , "Automated essay scoring using Bayes' Theorem". The Journal of Technology, Learning and Assessment, 1(2), 3-21.
- Valenti S. , Neri F. and Cucchiarelli A. 2003 , "An Overview of Current Research on Automated Essay Grading". Journal of Information Technology Education, 2:319–330, 2003.
- Williams R. and Dreher H. 2004 , "Automatically Grading Essays with Markit. In Proceedings of Informing Science 2004 Conference, Rockhampton, Queensland, Australia.
- Whittingdon D. and Hunt H. 1999 , "Approaches to the computerised assessment of free-text responses", In Proceedings of the 3rd International Computer Assisted Assessment Conference, 1999.
- Wiki 2011 , "The Rete Algorithm", Wikipedia Encyclopedia, www. en. wikipedia. org/wiki/rete_algorithm
Index Terms
Keywords