CFP last date
20 January 2025
Call for Paper
February Edition
IJCA solicits high quality original research papers for the upcoming February edition of the journal. The last date of research paper submission is 20 January 2025

Submit your paper
Know more
The week's pick
Responsive image
SFLA-Based Line Balancing and Task Optimization in Master-Slave Controlled Hanger Transportation Systems for Garment Production

Duc Hoang Nguyen
Random Articles
Reseach Article

Exploring the Correlation between Data Pipeline Quality and the Advantages of SQL-based Data Pipelines

by Ankush Ramprakash Gautam
journal cover thumbnail

International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 186 - Number 13
Year of Publication: 2024
Authors: Ankush Ramprakash Gautam
10.5120/ijca2024923497

Ankush Ramprakash Gautam . Exploring the Correlation between Data Pipeline Quality and the Advantages of SQL-based Data Pipelines. International Journal of Computer Applications. 186, 13 ( Mar 2024), 29-32. DOI=10.5120/ijca2024923497

@article{ 10.5120/ijca2024923497,
author = { Ankush Ramprakash Gautam },
title = { Exploring the Correlation between Data Pipeline Quality and the Advantages of SQL-based Data Pipelines },
journal = { International Journal of Computer Applications },
issue_date = { Mar 2024 },
volume = { 186 },
number = { 13 },
month = { Mar },
year = { 2024 },
issn = { 0975-8887 },
pages = { 29-32 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume186/number13/exploring-the-correlation-between-data-pipeline-quality-and-the-advantages-of-sql-based-data-pipelines/ },
doi = { 10.5120/ijca2024923497 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2024-03-27T00:44:38.435944+05:30
%A Ankush Ramprakash Gautam
%T Exploring the Correlation between Data Pipeline Quality and the Advantages of SQL-based Data Pipelines
%J International Journal of Computer Applications
%@ 0975-8887
%V 186
%N 13
%P 29-32
%D 2024
%I Foundation of Computer Science (FCS), NY, USA
Abstract

This research paper thoroughly examines the use of SQL based data pipelines, in the public cloud setting. Conventional approaches to data pipelines often face issues with securing data engineering resources for projects leading to setbacks and potential project failures. By utilizing SQL based data pipeline solutions available in the market organizations can speed up the development of their data lakes. Efficiently extract transformed datasets to support achieving desired outcomes. This enables businesses to improve efficiency, make informed decisions and gain a competitive edge within their industries. The article explores the benefits of employing SQL based data pipeline tools. Sheds light on the challenges associated with methods of creating data pipelines. Our analysis provides insights, for professionals aiming to optimize their data pipeline processes and maximize the value derived from their data.

References
  1. Amazon Data Pipeline definition [Online] https://aws.amazon.com/what-is/data-pipeline/
  2. Wikipedia SAAS definition [Online] https://en.wikipedia.org/wiki/Software_as_a_service
  3. Wikipedia SQL definition [Online] https://en.wikipedia.org/wiki/SQL
  4. Wikipedia Snowflake definition [Online] https://en.wikipedia.org/wiki/Snowflake_Inc.
  5. Wikipedia DBT definition [Online] https://en.wikipedia.org/wiki/Data_build_tool
Index Terms

Computer Science
Information Sciences
Data Pipelines
Data Quality

Keywords

Data Pipelines SQL Data Quality

Powered by PhDFocusTM