CFP last date
20 January 2025
Call for Paper
February Edition
IJCA solicits high quality original research papers for the upcoming February edition of the journal. The last date of research paper submission is 20 January 2025

Submit your paper
Know more
The week's pick
Responsive image
HYBRID ANN AND FIREWORKS ALGORITHM FOR REAL-TIME SOFTWARE RELIABILITY PREDICTION

Ivy Botchway Felix Larbi Aryeh Boniface Kayode Alese
Random Articles
Reseach Article

Survey on Task Assignment Techniques in Hadoop

by Sarika Patil, Shyam Deshmukh
journal cover thumbnail

International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 59 - Number 14
Year of Publication: 2012
Authors: Sarika Patil, Shyam Deshmukh
10.5120/9617-4256

Sarika Patil, Shyam Deshmukh . Survey on Task Assignment Techniques in Hadoop. International Journal of Computer Applications. 59, 14 ( December 2012), 15-18. DOI=10.5120/9617-4256

@article{ 10.5120/9617-4256,
author = { Sarika Patil, Shyam Deshmukh },
title = { Survey on Task Assignment Techniques in Hadoop },
journal = { International Journal of Computer Applications },
issue_date = { December 2012 },
volume = { 59 },
number = { 14 },
month = { December },
year = { 2012 },
issn = { 0975-8887 },
pages = { 15-18 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume59/number14/9617-4256/ },
doi = { 10.5120/9617-4256 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2024-02-06T21:04:12.876336+05:30
%A Sarika Patil
%A Shyam Deshmukh
%T Survey on Task Assignment Techniques in Hadoop
%J International Journal of Computer Applications
%@ 0975-8887
%V 59
%N 14
%P 15-18
%D 2012
%I Foundation of Computer Science (FCS), NY, USA
Abstract

MapReduce is an implementation for processing large scale data parallelly. Actual benefits of MapReduce occur when this framework is implemented in large scale, shared nothing cluster. MapReduce framework abstracts the complexity of running distributed data processing across multiple nodes in cluster. Hadoop is open source implementation of MapReduce framework, which processes the vast amount of data in parallel on large clusters. In Hadoop pluggable scheduler was implemented, because of this several algorithms have been developed till now. This paper presents the different schedulers used for Hadoop.

References
  1. Hadoop http://hadoop. apache. org/
  2. Jeffrey Dean and Sanjay Ghemawat, "MapReduce: Simplified Data Processing on Large Clusters, "In Communications of the ACM, Volume 51, Issue 1, pp. 107-113, 2008. J. Clerk Maxwell, A Treatise on Electricity and Magnetism, 3rd ed. , vol. 2. Oxford: Clarendon,1892, pp. 68–73.
  3. B. Thirumala Rao and Dr. L. S. S. Reddy,"Survey on Improved Scheduling in Hadoop MapReduce in Cloud Environments "
  4. Matei Zaharia, "The Hadoop Fair Scheduler" http://developer. yahoo. net/blogs/hadoop/FairSharePres. ppt.
  5. Hadoop's Capacity Scheduler, http://hadoop. apache. org/core/docs/current/capacity_scheduler. html.
  6. Matei Zaharia, Dhruba Borthakur, Joydeep Sen Sarma, Khaled Elmeleely, Scott Shenker and Ion Stoica, "Delay Scheduling: A Simple Technique For Achieving Locality and Fairness in Cluster Scheduling"
  7. Thomas Sandholm and Kevin Lai. Dynamic proportional share scheduling in hadoop. In JSSPP '10: 15th Workshop on Job Scheduling Strategies for Parallel Processing, April,2010
  8. K. Kc and K. Anyanwu, "Scheduling Hadoop Jobs to Meet Deadlines", in Proc. CloudCom, 2010, pp. 388-392.
  9. Mark Yong, Nitin Garegrat, Shiwali Mohan: "Towards a Resource Aware Scheduler in Hadoop" in Proc. ICWS, 2009, pp:102-109
  10. Jaideep Dhok and Vasudeva varma," Using Pattern Classification for Task Assignment in MapReduce"
  11. Jaideep Dhok, Nitesh Maheshwari and Vasudeva Varma,"Learning Based Opportunistic Admission Control Algorithm for MapReduce as a Service"
  12. Amazon Elastic Compute Cloud. http://aws. amazon. com/ec2/.
Index Terms

Computer Science
Information Sciences

Keywords

MapReduce Task Assignment Resource Management Scheduling

Powered by PhDFocusTM