International Journal of Computer Applications |
Foundation of Computer Science (FCS), NY, USA |
Volume 161 - Number 1 |
Year of Publication: 2017 |
Authors: V. I. Nnebedum |
10.5120/ijca2017912712 |
V. I. Nnebedum . Data Engineering: using Data Analysis Techniques in Producing Data Driven Products. International Journal of Computer Applications. 161, 1 ( Mar 2017), 13-16. DOI=10.5120/ijca2017912712
Data analysis is prominent in data science researches, but by each day data usage is expanding, and in recent times the usage is becoming indispensable and inseparable in all works of life including engineering profession. This is why data engineering as a discipline sprang up - using the data analysis techniques from statistics, machine learning, pattern recognition or neural networks, together with other technologies such as visualization, optimization, database systems, knowledge discovery etc to produce systems needed in diverse business, science and social science domains. This paper is a novel presentation of data analysis and data engineering discipline, focusing on critical issues that are relevant to both, but divulging more the new trend of moving data science beyond data analysis, to data engineering. Data engineering is a multi-disciplinary field with applications in control, decision theory, and in the emerging areas like bioinformatics. Data engineering is needed in critical activities for business, engineering, and scientific organizations, since service oriented architecture and web services has moved into full swing.