CFP last date
20 January 2025
Call for Paper
February Edition
IJCA solicits high quality original research papers for the upcoming February edition of the journal. The last date of research paper submission is 20 January 2025

Submit your paper
Know more
The week's pick
Responsive image
SFLA-Based Line Balancing and Task Optimization in Master-Slave Controlled Hanger Transportation Systems for Garment Production

Duc Hoang Nguyen
Random Articles
Reseach Article

Effective Question Answering Techniques and their Evaluation Metrics

by Jaspreet Kaur, Vishal Gupta
journal cover thumbnail

International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 65 - Number 12
Year of Publication: 2013
Authors: Jaspreet Kaur, Vishal Gupta
10.5120/10978-6122

Jaspreet Kaur, Vishal Gupta . Effective Question Answering Techniques and their Evaluation Metrics. International Journal of Computer Applications. 65, 12 ( March 2013), 30-37. DOI=10.5120/10978-6122

@article{ 10.5120/10978-6122,
author = { Jaspreet Kaur, Vishal Gupta },
title = { Effective Question Answering Techniques and their Evaluation Metrics },
journal = { International Journal of Computer Applications },
issue_date = { March 2013 },
volume = { 65 },
number = { 12 },
month = { March },
year = { 2013 },
issn = { 0975-8887 },
pages = { 30-37 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume65/number12/10978-6122/ },
doi = { 10.5120/10978-6122 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2024-02-06T21:20:59.078923+05:30
%A Jaspreet Kaur
%A Vishal Gupta
%T Effective Question Answering Techniques and their Evaluation Metrics
%J International Journal of Computer Applications
%@ 0975-8887
%V 65
%N 12
%P 30-37
%D 2013
%I Foundation of Computer Science (FCS), NY, USA
Abstract

Question Answering (QA) is a focused way of information retrieval. Question Answering system tries to get back the accurate answers to questions posed in natural language provided a set of documents. Basically question answering system (QA) has three elements i. e. question classification, information retrieval (IR), and answer extraction. These elements play a major role in Question Answering. In Question classification, the questions are classified depending upon the type of its entity. Information retrieval component is used to determine success by retrieving relevant answer for different questions posted by the intelligent question answering system. Answer extraction module is growing topics in the QA in which ranking and validating a candidate's answer is the major job. This paper offers a concise discussion regarding different Question Answering types. In addition we describe different evaluation metrics used to evaluate the performance of different question answering systems. We also discuss the recent question answering systems developed and their corresponding techniques.

References
  1. Gunawardena, T. , Lokuhetti, M. , Pathirana, N. , Ragel, R. , and Deegalla, S. 2010. An Automatic Answering System with template matching for Natural Language Questions. In Proceedings of IEEE ICIAfS.
  2. Ahn, C. M. , Lee, J. H. , Choi, B. , and Park, S. 2010. Question Answering System with Recommendation using Fuzzy Relational Product Operator. In Proceedings of ACM iiWAS Conference on Intelligent Systems, France.
  3. E. Voorhees. 1999. The TREC-8 question answering track evaluation. In The Eighth Text Retrieval Conference (TREC-8), pages 83–106. Department of Commerce, National Institute of Standards and Technology.
  4. Kamps, J. , Geva, S. , and Trotman, A. 2008. Report on the SIGIR workshop on focused retrieval. SIGIR Forum, 42(2):59 – 65, 2008.
  5. Smucker, M. D. , Allan, J. , and Dachev, B. 2012. Human Question Answering Performance Using an Interactive Document Retrieval System. In Poceedings of ACM lliX. Netherlands.
  6. Woods, W. A. , Kaplan, R. M. , and Webber, B. N. 1972. The Lunar Sciences Natural Language Information System: Final Report. BBN Report 2378, Bolt Beranek and Newman Inc. , Cambridge, Massachusetts.
  7. Green, W. , Chomsky, C. , and Laugherty K. 1961. BASEBALL: An automatic question answerer. In Proceedings of the Western Joint Computer Conference, 219-224.
  8. Fleischman, M. , Hovy, E. , and Echihabi, A. 2003. Offline strategies for online question answering: Answering questions before they are asked. ACL.
  9. Pakray, P. 2007. Multilingual Restricted Domain QA System with Dialogue Management ME Thesis. Jadavpur University of Kolkata.
  10. Ramprasath, M. and Hariharan, S. 2012. A Survey on Question Answering System. International Journal of Research and Reviews in Information Sciences. Vol. 2, No. 1.
  11. Brill, E. , Dumais, S. , and Banko, M. Ask MSR question answering system. Microsoft Research One Microsoft Way Redmond, Wa. 8052
  12. Kangavari, M. R. , Golpour, M. , and Ghandchi, S. 2008. World Academy of Science, Engineering and Technology.
  13. Yang, H. , Chua, T. S. , Wang, S. , and Koh, C. K. 2003. Structured use of external knowledge for event based open domain question answering. SIGIR.
  14. Voorhees, E. M. 2004. Overview of the TREC 2003 question answering track. In Proceedings of the 12th Text Retrieval Conference.
  15. START Question Answering System. Website: http://start. csail. mit. edu.
  16. AnswerBus, Question Answering System. Website: http://answerbus. com
  17. BrainBoost, Question Answering Sytem. Website: http://www. answers. com/bb/
  18. Yahoo! Question Answering System. Website: http://answers. yahoo. com/
  20. Inferret, Question Answring System. Website: http:/asked. jp
  21. Diekema, A. R. , Yilmazel, O. , and Liddy, E. D. 2004. Evaluation of Restricted Domain Question-Answering Systems. In Proceedings of the ACL2004 Workshop on Question Answering in Restricted Domain, 2-7.
  22. Nyberg, E. , Frederking, R. , Mitamura, T. , Bilotti, M. , Hiyakumoto, H. , and Ko J. , Lin, F. , Lita, L. , Pedro, V. , and Schlaikjer, A. 2005. JAVELIN I and II systems at TREC 2005. In Proceedings of TREC.
  23. Mitamura, T. , Lin, F. , Shima, H. , Wang, M. , Ko, J. , Betteridge, J. , Bilotti, M. , Schlaikjer, A. , and Nyberg, E. 2008. School of Computer Science. Carnegie Mellon University
  24. Reddy, R. R. N. and Bandyopadhyay, S. 2006. EACL Workshop on Multilingual Question Answering. MLQA).
  25. Eriksson, F. , Annika, and Arne, J. 2000. Dialogue and Domain Knowledge Management in Dialogue Systems. In Proceedings of 1st SIGDIAL workshop at ACL2000.
  26. Kurohashi, T. and Nagao, M. 1998. Japanese Morphological Analysis System JUMAN version 3. 6 Manual. Kyoto University. Japan.
  27. Kurohashi, S. 1998. Japanese Syntactic Parsing System Knp Version 2. 0 B6 Instruction Manual.
  28. Yamada, H. , Kudo, T. , and Matsumoto, Y. 2002. Japanese Named Entity Extraction Using Support Vector Machine. IPSJ Journal 43, 1 (Jan. ), 44–53. Japan.
  29. Joachims, T. 2002. SVMlight—Support vector machine. http://svmlight. joachims. org/.
  30. Fujihata, K. , Shiga, M. , and Andmori, T. 2001. Extraction of Numerical Expressions by Constraints and Default Rules of Dependency Structure. Sig Notes 2001-Nl-145. Information Processing Society of Japan.
  31. Mori, T. 2005. Japanese Question Answering System Using A* Search and Its Improvement. In ACM Transactions on Asian Language Information Processing, Vol. 4, No. 3, Pages 280–304.
  32. Day, M. Y. , Sung, L. C. , Lee, Y. H. , Jiang, T. J. , Wu, C. W. , Shih, C. W. , Chen, Y. R. , and Hsu, W. L. 2008. Boosting Chinese Question Answering with Two Lightweight Methods: ABSPs and SCO-QAT. In ACM Transactions on Asian Language Information Processing, Vol. 7, No. 4, Article 12.
  33. Lee, C. W. , Day, M. Y. , Sung, C. L. , Lee, Y. H. , Jiang, T. J. , Wu, C. W. , Shih, C. W. , Chen, Y. R. , and Hsu, W. L. 2007. Chinese-Chinese and English-Chinese question answering with ASQA at NTCIR-6 CLQA. In Proceedings of NII-NACSIS Test Collection for Information Retrieval Systems (NTCIR'07), Tokyo, Japan, 175–181.
  34. Sakai, T. 2007. On the Reliability of Factoid Question answering Evaluation. In ACM Transactions on Asian Language Information Processing, Vol. 6, No. 1, Article 3.
  35. Buckley, C. and Voorhees, E. M. 2000. Evaluating evaluation measure stability. In Proceedings of ACM SIGIR. 33–40. Language Information Processing, Vol. 7, No. 4, Article 12.
Index Terms

Computer Science
Information Sciences

Keywords

Natural Language Processing Question Answering System Evaluation Metrics Information Retrieval

Powered by PhDFocusTM