CFP last date
20 December 2024
Reseach Article

Overview of Search Engine and Crawler

by Gaurav Kumar Srivastav, Irphan Ali, Atul Kumar Srivastava
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 88 - Number 12
Year of Publication: 2014
Authors: Gaurav Kumar Srivastav, Irphan Ali, Atul Kumar Srivastava
10.5120/15402-3847

Gaurav Kumar Srivastav, Irphan Ali, Atul Kumar Srivastava . Overview of Search Engine and Crawler. International Journal of Computer Applications. 88, 12 ( February 2014), 9-11. DOI=10.5120/15402-3847

@article{ 10.5120/15402-3847,
author = { Gaurav Kumar Srivastav, Irphan Ali, Atul Kumar Srivastava },
title = { Overview of Search Engine and Crawler },
journal = { International Journal of Computer Applications },
issue_date = { February 2014 },
volume = { 88 },
number = { 12 },
month = { February },
year = { 2014 },
issn = { 0975-8887 },
pages = { 9-11 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume88/number12/15402-3847/ },
doi = { 10.5120/15402-3847 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2024-02-06T22:07:24.550687+05:30
%A Gaurav Kumar Srivastav
%A Irphan Ali
%A Atul Kumar Srivastava
%T Overview of Search Engine and Crawler
%J International Journal of Computer Applications
%@ 0975-8887
%V 88
%N 12
%P 9-11
%D 2014
%I Foundation of Computer Science (FCS), NY, USA
Abstract

Today, Internet is the most important part of human life but growth of internet is major problem of internet user due to internet down loading speed, quality of downloaded web pages and find out the relevant content in the millions number of web pages. Nowadays, internet offering the various services such as business, studies material, ecommerce and search engine on the internet. Due to it is increase the number of web pages in internet. In this paper we are solve the internet related problem by the help of search engine and improve the Quality of downloaded web pages for internet etc. Search Engine is find out the relevant content for the World Wide Web. We have solve other problem of search engine by the help of web crawler and proposed a working architecture of web crawler. Solve the problem of web crawler by the parallel web crawler.

References
  1. Junghoo Cho and Hector Garcia-Molina, "Incremental crawler and evolution of web", Technical Report, Department of Computer Science, Stanford University.
  2. V. Shkapenyuk , T. Suel, "Design and implementation of a high performance distributed Web crawler". In Proceedings of the 18th International Conference on Data Engineering (ICDE'02), San Jose, CA Feb. 26--March 1, pages 357 -368, 2002,.
  3. S. Chakrabarti, M. van den Berg, and B. Dom. Focused crawling: A new approach to topic-specific web resource discovery. In The 8th International World Wide Web Conference, 1999.
  4. Junghoo Cho, "Parallel Crawlers" proceedings of www2002, Honolulu, hawaii, USA, May 7-11, 2002. ACM 1-58113-449-5/02/005.
  5. Dilip Kumar Sharma, A. K. Sharma," A Novel Architecture for Deep Web Crawler", International Journal of Information Technology and Web Engineering, vol 6, issue 1, 25-48, January-March 2011.
  6. Divakar Yadav, A. K Sharma, J. P. Gupta, " Parallel crawler architecture and web page change detection", WSEAS transaction on computers, issue 7, volume 7, july 2008.
  7. Berners-Lee and Daniel Connolly, "Hypertext Markup Language. Internetworking draft", Published on the World Wide Web at http://www. w3. org/hypertext/WWW/MarkUp/HTML. html, 13 Jul 1993.
  8. Berners-Lee and Daniel Connolly, "Hypertext Markup Language. Internetworking draft", Published on the WWW at http://www. w3. org/hypertext/WWW/MarkUp/HTML. html.
  9. M. Levene (2005). An Introduction to Search Engine and Web Navigation. Addison Wesley.
  10. C. Olston&M. Najork (2010). Web Crawling. Now Publishers Inc.
Index Terms

Computer Science
Information Sciences

Keywords

World Wide Web Search Engine Web Crawler Parallel Web Crawler.