CFP last date
20 January 2025
Reseach Article

Leveraging Modern Data Processing & Engineering Techniques for Cosmological Simulations

by Soumyodeep Mukherjee
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 186 - Number 49
Year of Publication: 2024
Authors: Soumyodeep Mukherjee
10.5120/ijca2024924149

Soumyodeep Mukherjee . Leveraging Modern Data Processing & Engineering Techniques for Cosmological Simulations. International Journal of Computer Applications. 186, 49 ( Nov 2024), 22-25. DOI=10.5120/ijca2024924149

@article{ 10.5120/ijca2024924149,
author = { Soumyodeep Mukherjee },
title = { Leveraging Modern Data Processing & Engineering Techniques for Cosmological Simulations },
journal = { International Journal of Computer Applications },
issue_date = { Nov 2024 },
volume = { 186 },
number = { 49 },
month = { Nov },
year = { 2024 },
issn = { 0975-8887 },
pages = { 22-25 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume186/number49/leveraging-modern-data-processing-engineering-techniques-for-cosmological-simulations/ },
doi = { 10.5120/ijca2024924149 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2024-11-27T00:39:32.265554+05:30
%A Soumyodeep Mukherjee
%T Leveraging Modern Data Processing & Engineering Techniques for Cosmological Simulations
%J International Journal of Computer Applications
%@ 0975-8887
%V 186
%N 49
%P 22-25
%D 2024
%I Foundation of Computer Science (FCS), NY, USA
Abstract

Cosmological simulations play a crucial role in understanding the formation and evolution of the universe. As these simulations generate and process vast amounts of data, applying modern data engineering & processing techniques becomes essential to manage, analyze, and derive meaningful insights from this information. This paper explores how these techniques can optimize the performance, scalability, and accuracy of cosmological simulations. The focus is on the integration of distributed computing, real-time data processing, and advanced storage solutions to enhance simulations. Furthermore, examination was done to determine initial boundary conditions from observational data & discussion has been included in the paper on popular models used to simulate the universe's evolution and consideration of methods for tuning simulation parameters to balance accuracy with manageable data growth. Estimations of data generation and computational requirements are also provided, emphasizing the role of cloud computing in handling these challenges.

References
  1. Planck Collaboration. "Planck 2018 results. VI. Cosmological parameters." Astronomy & Astrophysics, 641 (2020): A6.
  2. Eisenstein, D. J., et al. "SDSS-III: Massive Spectroscopic Surveys of the Distant Universe, the Milky Way Galaxy, and Extra-Solar Planetary Systems." The Astronomical Journal 142.3 (2011): 72.
  3. Navarro, J. F., Frenk, C. S., & White, S. D. M. "A Universal Density Profile from Hierarchical Clustering." The Astrophysical Journal 490.2 (1997): 493-508.
  4. Springel, V., et al. "Simulations of the formation, evolution and clustering of galaxies and quasars." Nature 435.7042 (2005): 629-636.
  5. WMAP Collaboration, Hinshaw, G., et al. "Five-Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Data Processing, Sky Maps, and Basic Results." The Astrophysical Journal Supplement Series 180.2 (2009): 225.
  6. Springel, V., et al. "The large-scale structure of the Universe." Nature 435.7042 (2005): 629-636.
  7. Bond, J. R., et al. "Excursion set mass functions for hierarchical Gaussian fluctuations." The Astrophysical Journal 379 (1991): 440-460.
  8. Davis, M., et al. "The evolution of large-scale structure in a universe dominated by cold dark matter." The Astrophysical Journal 292 (1985): 371-394.
  9. Pfrommer, C., et al. "Simulating cosmic rays in clusters of galaxies – III. Non-thermal scaling relations and comparison to observations." Monthly Notices of the Royal Astronomical Society 378.2 (2007): 385-402.
  10. Weinberg, S. "Gravitation and Cosmology: Principles and Applications of the General Theory of Relativity." Wiley, 1972.
  11. Klypin, A., et al. "Resolving the Structure of Cold Dark Matter Halos." The Astrophysical Journal 522.1 (1999): 82-92.
  12. Navarro, J. F., Frenk, C. S., & White, S. D. M. "The Structure of Cold Dark Matter Halos." The Astrophysical Journal 462 (1996): 563.
  13. White, S. D. M., & Rees, M. J. "Core condensation in heavy halos: A two-stage theory for galaxy formation and clustering." Monthly Notices of the Royal Astronomical Society 183.3 (1978): 341-358.
  14. Peebles, P. J. E. "The large-scale structure of the universe." Princeton University Press, 1980.
  15. ]Mo, H. J., van den Bosch, F. C., & White, S. D. M. "Galaxy Formation and Evolution." Cambridge University Press, 2010
Index Terms

Computer Science
Information Sciences
Data Processing on Cosmological Simulation leveraging Data Engineering at scale

Keywords

Cosmological Simulations; Modern Data Engineering; Distributed Computing; High-Performance Computing; Cloud Computing