International Journal of Computer Applications |
Foundation of Computer Science (FCS), NY, USA |
Volume 63 - Number 3 |
Year of Publication: 2013 |
Authors: Yadu Nagar, Niraj Singhal |
10.5120/10446-5138 |
Yadu Nagar, Niraj Singhal . A Users Search History based Approach to Manage Revisit Frequency of an Incremental Crawler. International Journal of Computer Applications. 63, 3 ( February 2013), 18-22. DOI=10.5120/10446-5138
With the tremendous growth of the Internet, World Wide Web has become a huge source of hyperlinked information contained in hypertext documents. Search engines use web crawlers to collect these documents from web for the purpose of storage and indexing. An incremental crawler visits the web for updating its collection. There is a need to regulate the frequency of the crawler to visit web sites and provide latest information to the user. In this paper a novel approach to manage the revisiting frequency of an incremental crawler based on the users search history is being proposed.