The week's pick
Random Articles
Reseach Article
Effective Question Answering Techniques and their Evaluation Metrics
| International Journal of Computer Applications |
| Foundation of Computer Science (FCS), NY, USA |
| Volume 65 - Number 12 |
| Year of Publication: 2013 |
| Authors: Jaspreet Kaur, Vishal Gupta |
10.5120/10978-6122
|
Jaspreet Kaur, Vishal Gupta . Effective Question Answering Techniques and their Evaluation Metrics. International Journal of Computer Applications. 65, 12 ( March 2013), 30-37. DOI=10.5120/10978-6122
Abstract
Question Answering (QA) is a focused way of information retrieval. Question Answering system tries to get back the accurate answers to questions posed in natural language provided a set of documents. Basically question answering system (QA) has three elements i. e. question classification, information retrieval (IR), and answer extraction. These elements play a major role in Question Answering. In Question classification, the questions are classified depending upon the type of its entity. Information retrieval component is used to determine success by retrieving relevant answer for different questions posted by the intelligent question answering system. Answer extraction module is growing topics in the QA in which ranking and validating a candidate's answer is the major job. This paper offers a concise discussion regarding different Question Answering types. In addition we describe different evaluation metrics used to evaluate the performance of different question answering systems. We also discuss the recent question answering systems developed and their corresponding techniques.
References
- Gunawardena, T. , Lokuhetti, M. , Pathirana, N. , Ragel, R. , and Deegalla, S. 2010. An Automatic Answering System with template matching for Natural Language Questions. In Proceedings of IEEE ICIAfS.
- Ahn, C. M. , Lee, J. H. , Choi, B. , and Park, S. 2010. Question Answering System with Recommendation using Fuzzy Relational Product Operator. In Proceedings of ACM iiWAS Conference on Intelligent Systems, France.
- E. Voorhees. 1999. The TREC-8 question answering track evaluation. In The Eighth Text Retrieval Conference (TREC-8), pages 83–106. Department of Commerce, National Institute of Standards and Technology.
- Kamps, J. , Geva, S. , and Trotman, A. 2008. Report on the SIGIR workshop on focused retrieval. SIGIR Forum, 42(2):59 – 65, 2008.
- Smucker, M. D. , Allan, J. , and Dachev, B. 2012. Human Question Answering Performance Using an Interactive Document Retrieval System. In Poceedings of ACM lliX. Netherlands.
- Woods, W. A. , Kaplan, R. M. , and Webber, B. N. 1972. The Lunar Sciences Natural Language Information System: Final Report. BBN Report 2378, Bolt Beranek and Newman Inc. , Cambridge, Massachusetts.
- Green, W. , Chomsky, C. , and Laugherty K. 1961. BASEBALL: An automatic question answerer. In Proceedings of the Western Joint Computer Conference, 219-224.
- Fleischman, M. , Hovy, E. , and Echihabi, A. 2003. Offline strategies for online question answering: Answering questions before they are asked. ACL.
- Pakray, P. 2007. Multilingual Restricted Domain QA System with Dialogue Management ME Thesis. Jadavpur University of Kolkata.
- Ramprasath, M. and Hariharan, S. 2012. A Survey on Question Answering System. International Journal of Research and Reviews in Information Sciences. Vol. 2, No. 1.
- Brill, E. , Dumais, S. , and Banko, M. Ask MSR question answering system. Microsoft Research One Microsoft Way Redmond, Wa. 8052
- Kangavari, M. R. , Golpour, M. , and Ghandchi, S. 2008. World Academy of Science, Engineering and Technology.
- Yang, H. , Chua, T. S. , Wang, S. , and Koh, C. K. 2003. Structured use of external knowledge for event based open domain question answering. SIGIR.
- Voorhees, E. M. 2004. Overview of the TREC 2003 question answering track. In Proceedings of the 12th Text Retrieval Conference.
- START Question Answering System. Website: http://start. csail. mit. edu.
- AnswerBus, Question Answering System. Website: http://answerbus. com
- BrainBoost, Question Answering Sytem. Website: http://www. answers. com/bb/
- Yahoo! Question Answering System. Website: http://answers. yahoo. com/
- Inferret, Question Answring System. Website: http:/asked. jp
- Diekema, A. R. , Yilmazel, O. , and Liddy, E. D. 2004. Evaluation of Restricted Domain Question-Answering Systems. In Proceedings of the ACL2004 Workshop on Question Answering in Restricted Domain, 2-7.
- Nyberg, E. , Frederking, R. , Mitamura, T. , Bilotti, M. , Hiyakumoto, H. , and Ko J. , Lin, F. , Lita, L. , Pedro, V. , and Schlaikjer, A. 2005. JAVELIN I and II systems at TREC 2005. In Proceedings of TREC.
- Mitamura, T. , Lin, F. , Shima, H. , Wang, M. , Ko, J. , Betteridge, J. , Bilotti, M. , Schlaikjer, A. , and Nyberg, E. 2008. School of Computer Science. Carnegie Mellon University
- Reddy, R. R. N. and Bandyopadhyay, S. 2006. EACL Workshop on Multilingual Question Answering. MLQA).
- Eriksson, F. , Annika, and Arne, J. 2000. Dialogue and Domain Knowledge Management in Dialogue Systems. In Proceedings of 1st SIGDIAL workshop at ACL2000.
- Kurohashi, T. and Nagao, M. 1998. Japanese Morphological Analysis System JUMAN version 3. 6 Manual. Kyoto University. Japan.
- Kurohashi, S. 1998. Japanese Syntactic Parsing System Knp Version 2. 0 B6 Instruction Manual.
- Yamada, H. , Kudo, T. , and Matsumoto, Y. 2002. Japanese Named Entity Extraction Using Support Vector Machine. IPSJ Journal 43, 1 (Jan. ), 44–53. Japan.
- Joachims, T. 2002. SVMlight—Support vector machine. http://svmlight. joachims. org/.
- Fujihata, K. , Shiga, M. , and Andmori, T. 2001. Extraction of Numerical Expressions by Constraints and Default Rules of Dependency Structure. Sig Notes 2001-Nl-145. Information Processing Society of Japan.
- Mori, T. 2005. Japanese Question Answering System Using A* Search and Its Improvement. In ACM Transactions on Asian Language Information Processing, Vol. 4, No. 3, Pages 280–304.
- Day, M. Y. , Sung, L. C. , Lee, Y. H. , Jiang, T. J. , Wu, C. W. , Shih, C. W. , Chen, Y. R. , and Hsu, W. L. 2008. Boosting Chinese Question Answering with Two Lightweight Methods: ABSPs and SCO-QAT. In ACM Transactions on Asian Language Information Processing, Vol. 7, No. 4, Article 12.
- Lee, C. W. , Day, M. Y. , Sung, C. L. , Lee, Y. H. , Jiang, T. J. , Wu, C. W. , Shih, C. W. , Chen, Y. R. , and Hsu, W. L. 2007. Chinese-Chinese and English-Chinese question answering with ASQA at NTCIR-6 CLQA. In Proceedings of NII-NACSIS Test Collection for Information Retrieval Systems (NTCIR'07), Tokyo, Japan, 175–181.
- Sakai, T. 2007. On the Reliability of Factoid Question answering Evaluation. In ACM Transactions on Asian Language Information Processing, Vol. 6, No. 1, Article 3.
- Buckley, C. and Voorhees, E. M. 2000. Evaluating evaluation measure stability. In Proceedings of ACM SIGIR. 33–40. Language Information Processing, Vol. 7, No. 4, Article 12.
Index Terms
Keywords