CFP last date
20 January 2025
Call for Paper
February Edition
IJCA solicits high quality original research papers for the upcoming February edition of the journal. The last date of research paper submission is 20 January 2025

Submit your paper
Know more
The week's pick
Responsive image
Implementation of Feature Selection Using Correlation Matrix in Python

Ahmad Farhan AlShammari
Random Articles
Reseach Article

Analysis of Distributed Systems

by Ehsan Bazgir, Tasmita Tanjim Tanha, Anwarul Azim Bhuiyan, Ehteshamul Haque, Md Shihab Uddin
journal cover thumbnail

International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 186 - Number 48
Year of Publication: 2024
Authors: Ehsan Bazgir, Tasmita Tanjim Tanha, Anwarul Azim Bhuiyan, Ehteshamul Haque, Md Shihab Uddin
10.5120/ijca2024924136

Ehsan Bazgir, Tasmita Tanjim Tanha, Anwarul Azim Bhuiyan, Ehteshamul Haque, Md Shihab Uddin . Analysis of Distributed Systems. International Journal of Computer Applications. 186, 48 ( Nov 2024), 16-21. DOI=10.5120/ijca2024924136

@article{ 10.5120/ijca2024924136,
author = { Ehsan Bazgir, Tasmita Tanjim Tanha, Anwarul Azim Bhuiyan, Ehteshamul Haque, Md Shihab Uddin },
title = { Analysis of Distributed Systems },
journal = { International Journal of Computer Applications },
issue_date = { Nov 2024 },
volume = { 186 },
number = { 48 },
month = { Nov },
year = { 2024 },
issn = { 0975-8887 },
pages = { 16-21 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume186/number48/analysis-of-distributed-systems/ },
doi = { 10.5120/ijca2024924136 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2024-11-27T00:39:23.301101+05:30
%A Ehsan Bazgir
%A Tasmita Tanjim Tanha
%A Anwarul Azim Bhuiyan
%A Ehteshamul Haque
%A Md Shihab Uddin
%T Analysis of Distributed Systems
%J International Journal of Computer Applications
%@ 0975-8887
%V 186
%N 48
%P 16-21
%D 2024
%I Foundation of Computer Science (FCS), NY, USA
Abstract

Distributed computing systems have become a pivotal aspect of modern technology, enabling complex computations and tasks across various industries, including telecommunications, scientific research, and financial services. These systems provide scalability, fault tolerance, and resource sharing across multiple nodes, allowing for efficient handling of vast datasets. This paper discusses the characteristics, architectural styles, and middleware solutions that support distributed computing, with a focus on fault tolerance mechanisms and distributed consensus algorithms such as Paxos and Raft. Additionally, it compares notable frameworks like Apache Spark and Ray, which serve distinct roles in managing data processing and real-time computational tasks, respectively. The discussion highlights the importance of fault tolerance and resilience in ensuring the continuous operation of distributed systems in diverse applications.

References
  1. https://www.splunk.com/en_us/blog/learn/distributed-systems.html#:~:text=Distributed%20systems%20are%20used%20when,to%20news%20about%20your%20organization.
  2. van Steen, M., Tanenbaum, A.S. A brief introduction to distributed systems. Computing 98, 967–1009 (2016). https://doi.org/10.1007/s00607-016-0508-7
  3. P. S. Janardhanan and P. Samuel, "Launch overheads of spark applications on standalone and hadoop YARN clusters" in Advances in Electrical and Computer Technologies, Singapore:Springer, pp. 47-54, 2020.
  4. X. Sun, Y. He, D. Wu and J. Z. Huang, "Survey of Distributed Computing Frameworks for Supporting Big Data Analysis," in Big Data Mining and Analytics, vol. 6, no. 2, pp. 154-169, June 2023, doi: 10.26599/BDMA.2022.9020014.
  5. R. Gu, X. Yang, J. Yan, Y. Sun, B. Wang, C. Yuan, et al., "SHadoop: Improving MapReduce performance by optimizing job execution mechanism in hadoop clusters", J. Parallel Distribut. Comput., vol. 74, no. 3, pp. 2166-2179, 2014.
  6. I. Polato, R. Ré, A. Goldman and F. Kon, "A comprehensive view of hadoop research-A systematic literature review", J. Network Comput. Applicat., vol. 46, pp. 1-25, 2014.
  7. Y. Wang, W. Jiang and G. Agrawal, "SciMATE: A novel MapReduce-like framework for multiple scientific data formats", Proc. 2012 12 th IEEE/ACM Int. Symp. Cluster Cloud and Grid Computing (CCGRID 2012) , pp. 443-450, 2012.
  8. J. Dean and S. Ghemawat, "MapReduce: Simplified data processing on large clusters", Commun ACM, vol. 51, no. 1, pp. 107-113, 2008.
  9. M. R. Ghazi and D. Gangodkar, "Hadoop MapReduce and HDFS: A developers perspective", Proc. Comput. Sci., vol. 48, pp. 45-50, 2015.
  10. Y. Zhang, Q. Gao, L. Gao and C. Wang, "iMapReduce: A distributed computing framework for iterative computation", J. Grid Comput., vol. 10, no. 1, pp. 47-68, 2012.
  11. J. Yu, J. Wu and M. Sarwat, "A demonstration of geoSpark: A cluster computing framework for processing big spatial data", Proc. 2016 IEEE 32 nd Int. Conf. Data Engineering (ICDE) , pp. 1410-1413, 2016.
  12. Z. Yang, C. Zhang, M. Hu and F. Lin, "OPC: A distributed computing and memory computing-based effective solution of big data", Proc. 2015 IEEE Int. Conf. Smart City/ SocialCom/SustainCom (SmartCity), pp. 50-53, 2015.
  13. V. Taran, O. Alienin, S. Stirenko, Y. Gordienko and A. Rojbi, "Performance evaluation of distributed computing environments with Hadoop and spark frameworks", Proc. 2017 IEEE Int. Young Scientists Forum on Applied Physics and Engineering (YSF), pp. 80-83, 2017.
  14. T. D. Thanh, S. Mohan, E. Choi, S. Kim and P. Kim, "A taxonomy and survey on distributed file systems", Proc. 2008 4 th Int. Conf. Networked Computing and Advanced Information Management , pp. 144-149, 2008.
  15. J. Blomer, "A survey on distributed file system technology", J. Phys. Conf. Ser., vol. 608, pp. 012039, 2015.
  16. S. Ghemawat, H. Gobioff and S. T. Leung, "The google file system", ACM SIGOPS Oper. Syst. Rev., vol. 73, no. 5, pp. 29-43, 2003.
  17. L. Jiang, B. Li and M. Song, "The optimization of HDFS based on small files", Proc. 2010 3 rd IEEE Int. Conf. Broadband Network and Multimedia Technology (IC-BNMT) , pp. 912-915, 2010.
  18. S. Zhuo, X. Wu, W. Zhang and W. Dou, "Distributed file system and classification for small images", Proc. 2013 IEEE Int. Conf. Green Computing and Communications and IEEE Internet of Things and IEEE Cyber Physical and Social Computing, pp. 2231-2234, 2013.
  19. H. Che and H. Zhang, "Exploiting fastDFS client-based small file merging", Proc. 2016 Int. Conf Artificial Intelligence and Engineering Applications, pp. 242-246, 2016.
  20. Z. Ullah, S. Jabbar, M. H. Bin, Tariq Alvi and A. Ahmad, "Analytical study on performance challenges and future considerations of Google file system", Int. J. Computer Communicat. Eng., vol. 3, no. 4, pp. 279-284, 2014.
  21. https://medium.com/@ayeshwery/architectures-in-distributed-system-b2ace2fca6bb
  22. Tanenbaum, A.S., & Van Steen, M. (2017). "Distributed Systems: Principles and Paradigms."
  23. Chandra, T.D., & Toueg, S. (1996). "Unreliable Failure Detectors for Reliable Distributed Systems."
  24. https://medium.com/@mani.saksham12/raft-and-paxos-consensus-algorithms-for-distributed-systems-138cd7c2d35a
  25. Ongaro, D., & Ousterhout, J. (2014). "In Search of an Understandable Consensus Algorithm."
  26. https://kafka.apache.org/documentation/
  27. https://medium.com/@kajol_singh/unveiling-apache-kafka-a-comprehensive-guide-to-core-concepts-and-functionality-2efd51de2b89
  28. https://bair.berkeley.edu/blog/2018/01/09/ray/
  29. Moritz, Philipp, et al. "Ray: A distributed framework for emerging {AI} applications." 13th USENIX symposium on operating systems design and implementation (OSDI 18). 2018.
  30. https://www.datacamp.com/tutorial/distributed-processing-using-ray-framework-in-python
  31. Hoque, K., Hossain, M. B., Sami, A., Das, D., Kadir, A., & Rahman, M. A. (2024). Technological trends in 5G networks for IoT-enabled smart healthcare: A review. International Journal of Science and Research Archive, 12(2), 1399-1410.
  32. Md Shihab Uddin. Addressing IoT Security Challenges through AI Solutions. International Journal of Computer Applications. 186, 45 (Oct 2024), 50-55. DOI=10.5120/ijca2024924107
  33. Khandoker Hoque, Md Boktiar Hossain, Denesh Das, Partha Protim Roy. Integration of IoT in Energy Sector. International Journal of Computer Applications. 186, 36 (Aug 2024), 32-40. DOI=10.5120/ijca2024923981
  34. Md Maniruzzaman, Md Shihab Uddin, Md Boktiar Hossain, Khandoker Hoque, “Understanding COVID-19 Through Tweets using Machine Learning: A Visualization of Trends and Conversations”, European Journal of Advances in Engineering and Technology, Vol. 10, Issue: 5, pp. 108-114, 2023.
  35. Md Boktiar Hossain, Khandoker Hoque, Mohammad Atikur Rahman, Priya Podder, Deepak Gupta, “Hepatitis C Prediction Applying Different ML Classification Algorithm”, International Conference on Computing and Communication Networks 2024 (ICCCNet 2024), 2024.
  36. Javed Mehedi Shamrat, F. M., Tasnim, Z., Chowdhury, T. R., Shema, R., Uddin, M. S., & Sultana, Z. (2022). Multiple cascading algorithms to evaluate performance of face detection. In Pervasive Computing and Social Networking: Proceedings of ICPCSN 2021 (pp. 89-102). Springer Singapore.
  37. Javed Mehedi Shamrat, F. M., Ghosh, P., Tasnim, Z., Khan, A. A., Uddin, M. S., & Chowdhury, T. R. (2022). Human Face recognition using eigenface, SURF method. In Pervasive Computing and Social Networking: Proceedings of ICPCSN 2021 (pp. 73-88). Springer Singapore.
  38. Kowsher, M., Tahabilder, A., Sanjid, M. Z. I., Prottasha, N. J., Uddin, M. S., Hossain, M. A., & Jilani, M. A. K. (2021). LSTM-ANN & BiLSTM-ANN: Hybrid deep learning models for enhanced classification accuracy. Procedia Computer Science, 193, 131-140.
  39. Mondai, R., & Rahman, M. M. (2017, July). Dynamic analysis of variable structure based sliding mode intelligent load frequency control of interconnected nonlinear conventional and renewable power system. In 2017 International Conference on Intelligent Computing, Instrumentation and Control Technologies (ICICICT) (pp. 393-400). IEEE.
  40. Bharati, S., Rahman, M. A., Mondal, R., Podder, P., Alvi, A. A., & Mahmood, A. (2020). Prediction of energy consumed by home appliances with the visualization of plot analysis applying different classification algorithm. In Frontiers in Intelligent Computing: Theory and Applications: Proceedings of the 7th International Conference on FICTA (2018), Volume 2 (pp. 246-257). Springer Singapore.
  41. Hoque, R., Maniruzzaman, M., Michael, D. L., & Hoque, M. (2024). Empowering blockchain with SmartNIC: Enhancing performance, security, and scalability. World Journal of Advanced Research and Reviews, 22(1), 151-162.
  42. Amit Deb Nath, Rahmanul Hoque, Md. Masum Billah, Numair Bin Sharif, Mahmudul Hoque. Distributed Parallel and Cloud Computing: A Review. International Journal of Computer Applications. 186, 16 (Apr 2024), 25-32. DOI=10.5120/ijca2024923547
  43. Maniruzzaman, M., Sami, A., Hoque, R., & Mandal, P. (2024). Pneumonia prediction using deep learning in chest X-ray Images. International Journal of Science and Research Archive, 12(1), 767-773.
  44. M. S. Miah and M. S. Islam, "Big Data Analytics Architectural Data Cut off Tactics for Cyber Security and Its Implication in Digital forensic," 2022 International Conference on Futuristic Technologies (INCOFT), Belgaum, India, 2022, pp. 1-6, doi: 10.1109/INCOFT55651.2022.10094342.
  45. Obaida, M. A., Miah, M. S., & Horaira, M. A. (2011). Random Early Discard (RED-AQM) Performance Analysis in Terms of TCP Variants and Network Parameters: Instability in High-Bandwidth-Delay Network. International Journal of Computer Applications, 27(8), 40-44.
Index Terms

Computer Science
Information Sciences

Keywords

Distributed Systems Fault Tolerance Scalability MapReduce Apache Spark Ray Framework. Middleware Distributed File Systems Paxos Algorithm

Powered by PhDFocusTM