CFP last date
20 December 2024
Reseach Article

Study and Experimental Setup of Testing of Performance Parameters on Various Distributed File Systems

by Madhavi Vaidya, Shrinivas Deshpande
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 159 - Number 9
Year of Publication: 2017
Authors: Madhavi Vaidya, Shrinivas Deshpande
10.5120/ijca2017913077

Madhavi Vaidya, Shrinivas Deshpande . Study and Experimental Setup of Testing of Performance Parameters on Various Distributed File Systems. International Journal of Computer Applications. 159, 9 ( Feb 2017), 23-27. DOI=10.5120/ijca2017913077

@article{ 10.5120/ijca2017913077,
author = { Madhavi Vaidya, Shrinivas Deshpande },
title = { Study and Experimental Setup of Testing of Performance Parameters on Various Distributed File Systems },
journal = { International Journal of Computer Applications },
issue_date = { Feb 2017 },
volume = { 159 },
number = { 9 },
month = { Feb },
year = { 2017 },
issn = { 0975-8887 },
pages = { 23-27 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume159/number9/27031-2017913077/ },
doi = { 10.5120/ijca2017913077 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2024-02-07T00:05:20.996173+05:30
%A Madhavi Vaidya
%A Shrinivas Deshpande
%T Study and Experimental Setup of Testing of Performance Parameters on Various Distributed File Systems
%J International Journal of Computer Applications
%@ 0975-8887
%V 159
%N 9
%P 23-27
%D 2017
%I Foundation of Computer Science (FCS), NY, USA
Abstract

Distributed File System (DFS) is acting as an extension to file system which manages files and data on multiple storage devices and provides more performance and reliability using various modern techniques. Outside world only sees the distributed file system as a single storage device and it is nothing but an interface to a great extent. In case of failure or heavy load very few Distributed file systems provide location transparency and redundancy to improve the data availability. Significant challenges for such a distributed file system are extended to a large number of storage nodes and providing reasonably. In this paper, there is been a few performance collaborative parameters have been studied viz. replication, fault tolerance and load balancing experimentally on various DFS.

References
  1. S. Ghemawat et al, 2003, The Google File System. ACM SIGOPS Operating Systems Review, 37(5):29–43.
  2. J. Dean et al. 2008, MapReduce Simplified Data Processing on Large Clusters. Communications of the ACM, 51(1):107–113.
  3. Jeffrey Dean et al., 2004, Mapreduce: Simplified Data Processing on Large Clusters. In In Proceedings of the 6th USENIX OSDI, pages 137–150.
  4. Rodeh and Teperman, 2003,A Scalable Distributed File System Using Object Disks. Proceedings of the 20th IEEE Conference on Mass Storage Systems and Technology (MSS’03), San Diego, CA, pp. 207–218.
  5. http://www.lustre.org/docs/whitepaper.pdf
  6. C. Kim and H. Kameda, March 1992, An Algorithm for Optimal Static Load Balancing in Distributed Computer Systems. IEEE Trans. Compute., 41(3):381–384.
  7. C. McCann, R. Vaswani, and J. Zarhojan, May 1993, A Dynamic Processor Allocation Policy for Multiprogrammed Shared-Memory Multiprocessors. ACM Transactions on Computer Systems (TOCS), vol. 11, no. 2, pp. 146–178.
  8. M. Litzkow, M. Livny, and M. Mutka, Condor, June 1988 A Hunter of Idle Workstations. International Conference on Distributed Computing Systems, pp. 104-111.
  9. Sevilla, Michael A., et al., 2015, Mantle: A Programmable Metadata Load Balancer for the Ceph File System. Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis. ACM.
  10. Petros Koutoupis, June 2016, http://www.linuxjournal.com/content/understanding-ceph-and-its-place-market,
  11. Weil, Sage A., et al. Ceph: A Scalable, High-Performance Distributed , 2006, File System. Proceedings of the 7th symposium on Operating Systems Design and Implementation. USENIX Association.
  12. Teperman, A. and A. Weit, 2004, Improving Performance of a Distributed File System using OSDs and Cooperative Cach. IBM Journal of Research and Development.
  13. O. Rodeh and A. Teperman, 2003, zFS, A Scalable Distributed File System using Object Disks. InProceedings of the IEEE Mass Storage Systems and Technologies Conference, pp 207-218,San Diego, CA, USA.
  14. Apache Hadoop Documentation
Index Terms

Computer Science
Information Sciences

Keywords

DFS Hadoop Ceph Balancing