CFP last date
20 January 2025
Call for Paper
February Edition
IJCA solicits high quality original research papers for the upcoming February edition of the journal. The last date of research paper submission is 20 January 2025

Submit your paper
Know more
The week's pick
Responsive image
SFLA-Based Line Balancing and Task Optimization in Master-Slave Controlled Hanger Transportation Systems for Garment Production

Duc Hoang Nguyen
Random Articles
Reseach Article

SIEM: An Integrated Evaluation Metric for Measuring Search Engine's Performance

by Sojdeh Lotfipour, Fatemeh Ahmadi-abkenari
journal cover thumbnail

International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 108 - Number 5
Year of Publication: 2014
Authors: Sojdeh Lotfipour, Fatemeh Ahmadi-abkenari
10.5120/18906-0202

Sojdeh Lotfipour, Fatemeh Ahmadi-abkenari . SIEM: An Integrated Evaluation Metric for Measuring Search Engine's Performance. International Journal of Computer Applications. 108, 5 ( December 2014), 10-16. DOI=10.5120/18906-0202

@article{ 10.5120/18906-0202,
author = { Sojdeh Lotfipour, Fatemeh Ahmadi-abkenari },
title = { SIEM: An Integrated Evaluation Metric for Measuring Search Engine's Performance },
journal = { International Journal of Computer Applications },
issue_date = { December 2014 },
volume = { 108 },
number = { 5 },
month = { December },
year = { 2014 },
issn = { 0975-8887 },
pages = { 10-16 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume108/number5/18906-0202/ },
doi = { 10.5120/18906-0202 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2024-02-06T22:42:11.393490+05:30
%A Sojdeh Lotfipour
%A Fatemeh Ahmadi-abkenari
%T SIEM: An Integrated Evaluation Metric for Measuring Search Engine's Performance
%J International Journal of Computer Applications
%@ 0975-8887
%V 108
%N 5
%P 10-16
%D 2014
%I Foundation of Computer Science (FCS), NY, USA
Abstract

Search engines as Web-based information retrieval applications traverse a database consisting of millions of Web documents upon receiving a user issued query. In order to evaluate the accuracy and strength of a search engine regarding its robustness in finding relevant Web documents, a set of metrics have been proposed by researchers that each of them evaluates one aspect of a search engine's performance. One of the existing challenges in this area is the lack of one measurement that could state a search engines performance from different perspectives. Some of developed metrics so far are general information retrieval evaluation measures that are not designed as specialized tools for search engine's evaluation. Some other metrics measure the system ability in finding accurate data while other metrics measures the speed of the system for performing the search process. In this paper different evaluation metrics such as precision, recall, f-measure, MAP, MRR, DCG and NDCG will be discussed. Then according to the conducted experiment and an analytical solution, a hybrid evaluation metric is proposed that based on it the overall strength of a search engine could be measured.

References
  1. Ahmadi-Abkenari, F. , Selamat, A. 2012. "An Architecture for a Focused Trend Parallel Web Crawler with the Application of Clickstream Analysis", International Journal of Information Sciences, Elsevier, Vol. 184, pp. 266-281.
  2. Ahmadi-Abkenari, F. , and Selamat, A. 2013. "Advantages of Employing LogRank Web Page Importance Metric in Domain Specific Web Search Engines". JDCTA: International Journal of Digital Content Technology and its Applications. Vol. 7, No. 9. pp. 425-432.
  3. Ahmadi-Abkenari, F. , and Selamat, A. 2012. "LogRank: A Clickstream-based Web Page Importance Metric for Web Crawlers". JDCTA: International Journal of Digital Content Technology and its Applications. Vol. 6, No. 1. pp. 200-207.
  4. Clarke, C. L. A, Craswell, N. and Soboroff, I . 2009. "Overview of the TREC" 2009 Web Track.
  5. Cleverdon, C. W. and Keen, M. 1966. "Factors Determining the Performance of Indexing Systems". Cranfield, England, Aslib Cranfield Research Project.
  6. Cooper, W. S. 1973. "On Selecting a Measure of Retrieval Effectiveness". pp. 87-100.
  7. De Kunder, M. 2012. "The Size of the World Wide Web". Retrieved from: Retrieved from http://www. worldwidewebsize. com/.
  8. Fawcelt, T. 2006. "An Introduction to ROC Analysis". Pattern Recognition Letters 27 (8). pp. 861 – 874.
  9. Heinrich, H. 2012. "On Search Engine Evaluation Metrics". Dusseldorf. pp. 3-192.
  10. Järvelin, K. and J. Kekäläinen . 2000. "IR Evaluation Methods for Retrieving Highly Relevant Documents". In Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval . pp. 41-48.
  11. Malekian, Ehsan. 1979. "Principles of Internet Engineering". NAS Publications. pp. 481-486.
  12. Perruchet, P. and Peereman, R. 2004. "The Exploitation of Distributional Information in Syllable Processing". Journal of Neurolinguistics 17. pp. 97?119.
  13. Powers, D. M. W, 2011. "Evaluation: From Precision, Recall and F-measure to ROC Informedness, Markedness and Correlation". Machine Learning Technologies 2 (1). pp. 37–63.
  14. Rakesh Kumar, P. K. Suri & Chauhan, R. K. 2005. "Search Engines Evaluation". Desidoc Bulletin of Information Technology. Vol. 25, No. 2. pp. 3-10.
  15. Song, M. , Wu, Y. 2009. "Handbook of Research on Text and Web Mining Technologies". Information Science Reference. Vol. 2.
  16. Van Rijsbergen, C. J. 1979. "Retrieval effectiveness. In: Progress in communication science". Vol. 1. pp. 91-118.
  17. Vaughan. L. 2004. "New Measurements for Search Engine Evaluation Proposed and Tested". 40(4). Information Processing and Management. pp. 677-691.
  18. Voorhees, E. M. 1999. "The TREC 8 Question Answering Track Report". In Proceedings of the 8th Text Retrieval Conference (TREC 8) Gaithersburg. pp. 77-82.
  19. Wesley, A. 2008. "Evaluating Search Engines". Chapter 8. pp. 1-40.
Index Terms

Computer Science
Information Sciences

Keywords

Evaluation Metrics Search Engine Evaluation Web Information Retrieval.

Powered by PhDFocusTM