The week's pick
Random Articles
Reseach Article
SIEM: An Integrated Evaluation Metric for Measuring Search Engine's Performance
| International Journal of Computer Applications |
| Foundation of Computer Science (FCS), NY, USA |
| Volume 108 - Number 5 |
| Year of Publication: 2014 |
| Authors: Sojdeh Lotfipour, Fatemeh Ahmadi-abkenari |
10.5120/18906-0202
|
Sojdeh Lotfipour, Fatemeh Ahmadi-abkenari . SIEM: An Integrated Evaluation Metric for Measuring Search Engine's Performance. International Journal of Computer Applications. 108, 5 ( December 2014), 10-16. DOI=10.5120/18906-0202
Abstract
Search engines as Web-based information retrieval applications traverse a database consisting of millions of Web documents upon receiving a user issued query. In order to evaluate the accuracy and strength of a search engine regarding its robustness in finding relevant Web documents, a set of metrics have been proposed by researchers that each of them evaluates one aspect of a search engine's performance. One of the existing challenges in this area is the lack of one measurement that could state a search engines performance from different perspectives. Some of developed metrics so far are general information retrieval evaluation measures that are not designed as specialized tools for search engine's evaluation. Some other metrics measure the system ability in finding accurate data while other metrics measures the speed of the system for performing the search process. In this paper different evaluation metrics such as precision, recall, f-measure, MAP, MRR, DCG and NDCG will be discussed. Then according to the conducted experiment and an analytical solution, a hybrid evaluation metric is proposed that based on it the overall strength of a search engine could be measured.
References
- Ahmadi-Abkenari, F. , Selamat, A. 2012. "An Architecture for a Focused Trend Parallel Web Crawler with the Application of Clickstream Analysis", International Journal of Information Sciences, Elsevier, Vol. 184, pp. 266-281.
- Ahmadi-Abkenari, F. , and Selamat, A. 2013. "Advantages of Employing LogRank Web Page Importance Metric in Domain Specific Web Search Engines". JDCTA: International Journal of Digital Content Technology and its Applications. Vol. 7, No. 9. pp. 425-432.
- Ahmadi-Abkenari, F. , and Selamat, A. 2012. "LogRank: A Clickstream-based Web Page Importance Metric for Web Crawlers". JDCTA: International Journal of Digital Content Technology and its Applications. Vol. 6, No. 1. pp. 200-207.
- Clarke, C. L. A, Craswell, N. and Soboroff, I . 2009. "Overview of the TREC" 2009 Web Track.
- Cleverdon, C. W. and Keen, M. 1966. "Factors Determining the Performance of Indexing Systems". Cranfield, England, Aslib Cranfield Research Project.
- Cooper, W. S. 1973. "On Selecting a Measure of Retrieval Effectiveness". pp. 87-100.
- De Kunder, M. 2012. "The Size of the World Wide Web". Retrieved from: Retrieved from http://www. worldwidewebsize. com/.
- Fawcelt, T. 2006. "An Introduction to ROC Analysis". Pattern Recognition Letters 27 (8). pp. 861 – 874.
- Heinrich, H. 2012. "On Search Engine Evaluation Metrics". Dusseldorf. pp. 3-192.
- Järvelin, K. and J. Kekäläinen . 2000. "IR Evaluation Methods for Retrieving Highly Relevant Documents". In Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval . pp. 41-48.
- Malekian, Ehsan. 1979. "Principles of Internet Engineering". NAS Publications. pp. 481-486.
- Perruchet, P. and Peereman, R. 2004. "The Exploitation of Distributional Information in Syllable Processing". Journal of Neurolinguistics 17. pp. 97?119.
- Powers, D. M. W, 2011. "Evaluation: From Precision, Recall and F-measure to ROC Informedness, Markedness and Correlation". Machine Learning Technologies 2 (1). pp. 37–63.
- Rakesh Kumar, P. K. Suri & Chauhan, R. K. 2005. "Search Engines Evaluation". Desidoc Bulletin of Information Technology. Vol. 25, No. 2. pp. 3-10.
- Song, M. , Wu, Y. 2009. "Handbook of Research on Text and Web Mining Technologies". Information Science Reference. Vol. 2.
- Van Rijsbergen, C. J. 1979. "Retrieval effectiveness. In: Progress in communication science". Vol. 1. pp. 91-118.
- Vaughan. L. 2004. "New Measurements for Search Engine Evaluation Proposed and Tested". 40(4). Information Processing and Management. pp. 677-691.
- Voorhees, E. M. 1999. "The TREC 8 Question Answering Track Report". In Proceedings of the 8th Text Retrieval Conference (TREC 8) Gaithersburg. pp. 77-82.
- Wesley, A. 2008. "Evaluating Search Engines". Chapter 8. pp. 1-40.
Index Terms
Keywords