CFP last date
20 January 2025
Reseach Article

Data Scheduler Throughput Prediction using Estimation and Optimization Server for MTC

Published on May 2012 by Ch. Mohana Bindu, N. Sri Priya
National Conference on Advances in Computer Science and Applications (NCACSA 2012)
Foundation of Computer Science USA
NCACSA - Number 4
May 2012
Authors: Ch. Mohana Bindu, N. Sri Priya
1284a437-939f-4600-a52b-e33ac43b7b02

Ch. Mohana Bindu, N. Sri Priya . Data Scheduler Throughput Prediction using Estimation and Optimization Server for MTC. National Conference on Advances in Computer Science and Applications (NCACSA 2012). NCACSA, 4 (May 2012), 13-16.

@article{
author = { Ch. Mohana Bindu, N. Sri Priya },
title = { Data Scheduler Throughput Prediction using Estimation and Optimization Server for MTC },
journal = { National Conference on Advances in Computer Science and Applications (NCACSA 2012) },
issue_date = { May 2012 },
volume = { NCACSA },
number = { 4 },
month = { May },
year = { 2012 },
issn = 0975-8887,
pages = { 13-16 },
numpages = 4,
url = { /proceedings/ncacsa/number4/6500-1025/ },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Proceeding Article
%1 National Conference on Advances in Computer Science and Applications (NCACSA 2012)
%A Ch. Mohana Bindu
%A N. Sri Priya
%T Data Scheduler Throughput Prediction using Estimation and Optimization Server for MTC
%J National Conference on Advances in Computer Science and Applications (NCACSA 2012)
%@ 0975-8887
%V NCACSA
%N 4
%P 13-16
%D 2012
%I International Journal of Computer Applications
Abstract

Design and implementation of an application-layer data throughput prediction and optimization service for many-task computing in widely distributed environments. This service uses multiple parallel TCP streams to improve the end-to-end throughput of data transfers. A novel mathematical model is developed to determine the number of parallel streams, required to achieve the best network performance. This model can predict the optimal number of parallel streams with as few as three prediction points. We implement this new service in the Stork Data Scheduler. We propose Stork data transfer jobs with optimization service can be completed much earlier compared to non-optimized data transfer jobs.

References
  1. Allcock . W, Bresnahan . J, Kettimuthu . R, Link . M, Dumitrescu . C, Raicu . I, and Foster . I, "The Globus Striped Gridftp Framework and Server," Proc. 2005 ACM/IEEE Conf. Supercomputing (SC'05), p. 54, 2005.
  2. Altman . E, Barman . D, Tuffin . B, and Vojnovic . M, "Parallel TCP Sockets: Simple Model, Throughput and Validation," Proc. IEEE INFOCOM '06, pp. 1-12, Apr. 2006.
  3. Karrer . R. P, Park . J, and Kim . J, "TCP-ROME: Performance and Fairness in Parallel Downloads for Web and Real Time Multimedia Streaming Applications," technical report, Deutsche Telekom Labs,2006.
  4. Kosar . T and Livny . M, "Stork: Making Data Placement a First Class Citizen in the Grid," Proc. IEEE Int'l Conf. Distributed Computing Systems (ICDCS '04), pp. 342-349, 2004.
  5. Raicu . I, Foster . I , and Zhao . Y, "Many-Task Computing for Grids and Supercomputers," Proc. IEEE Workshop Many-Task Computing on Grids and Supercomputers (MTAGS), 2008.
  6. Timothy G. Armstrong, "Scheduling Many-Task Workloads on Supercomputers: Dealing with Trailing Tasks," Zhao Zhang Department of Computer Science University of Chicago.
  7. Yildirim . E, Yin . D, and Kosar . T, "Prediction of Optimal Parallelism Level in Wide Area Data Transfers," to be published in IEEE Trans. Parallel and Distributed Systems, 2010.
Index Terms

Computer Science
Information Sciences

Keywords

Many Task Computing Scheduling