CFP last date
20 January 2025
Reseach Article

From Data Warehouses to Streaming Warehouses: A Survey on the Challenges for Real-Time Data Warehousing and Available Solutions

by Revathy. S, Saravana Balaji. B, N. K. Karthikeyan
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 81 - Number 2
Year of Publication: 2013
Authors: Revathy. S, Saravana Balaji. B, N. K. Karthikeyan
10.5120/13984-1990

Revathy. S, Saravana Balaji. B, N. K. Karthikeyan . From Data Warehouses to Streaming Warehouses: A Survey on the Challenges for Real-Time Data Warehousing and Available Solutions. International Journal of Computer Applications. 81, 2 ( November 2013), 15-18. DOI=10.5120/13984-1990

@article{ 10.5120/13984-1990,
author = { Revathy. S, Saravana Balaji. B, N. K. Karthikeyan },
title = { From Data Warehouses to Streaming Warehouses: A Survey on the Challenges for Real-Time Data Warehousing and Available Solutions },
journal = { International Journal of Computer Applications },
issue_date = { November 2013 },
volume = { 81 },
number = { 2 },
month = { November },
year = { 2013 },
issn = { 0975-8887 },
pages = { 15-18 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume81/number2/13984-1990/ },
doi = { 10.5120/13984-1990 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2024-02-06T21:56:34.841773+05:30
%A Revathy. S
%A Saravana Balaji. B
%A N. K. Karthikeyan
%T From Data Warehouses to Streaming Warehouses: A Survey on the Challenges for Real-Time Data Warehousing and Available Solutions
%J International Journal of Computer Applications
%@ 0975-8887
%V 81
%N 2
%P 15-18
%D 2013
%I Foundation of Computer Science (FCS), NY, USA
Abstract

Data Warehouses usually work on history data. In most cases, the Data Warehouse is loaded with data from operational or transactional systems on a weekly or nightly basis. As today's decisions in the business world are becoming real-time, it is only natural that Data Warehouse, Business Intelligence, Decision Support and OLAP systems must quickly begin incorporating real-time data. When shifting from a traditional offline and time-consuming data warehousing system to a real-time system, two important considerations are speeding up the ETL and the OLAP process. This survey looks into the various challenges involved in building a real-time Data Warehouse and some of the solutions available to overcome them.

References
  1. Oracle Data Warehousing Guide – Oracle Documentation,docs. oracle. com/cd/B28359_01/server. 111/b28313. pdf by P Lane.
  2. The Data Warehouse Lifecycle Toolkit ,Ralph Kimball, Margy Ross ,Warren Thornthwaite ,Joy Mundy , Bob Becker , John Wiley & Sons; 2nd Edition.
  3. Dr. Kamal Kakish Dr. Theresa A. kraft , ETL Evolution for Real-Time Data Warehousing,2012, Proceedings of the Conference on Information Systems Applied Research ,New Orleans Louisiana, USA , ISSN:2167-1508 , v5 n2214.
  4. Mohamed A. Sharaf, Alexandros Labrinidis, Panos K. Chrysanthis , ETL Scheduling Continuous Queries in Data Stream Management Systems, ACM 978-1-60558-306-8/08/08.
  5. Langseth, J. , "Real-Time Data Warehousing: Challenges and Solutions", http://dssresources. com/papers/features/ langseth/langseth02082004. html
  6. Lucas Golab, Theodere Johnson , Vladislav Shkapenyuk Scalable, Scheduling of Updates in Streaming Data Warehouse, IEEE Transactions on knowledge and data engineering ,Vol. 24, N0. 6, JUNE 2012.
  7. Agrawal , D. , The Reality of Real-Time Business Intelligence, Proceedings of the 2nd International Workshop on Business Intelligence For the Real Time Enterprise (BIRTE 2008), Springer , LNBIP 27 , 75-88.
  8. Lukasz Golab and Theodore Johnson, Consistency in a Stream Warehouse, 5th Biennial Conference on Innovative Data Systems Research (CIDR '11) January 9-12, 2011, Asilomar, California, USA.
  9. Chaudhuri, S. , Dayal, U. , Narasayya, V. , (2011) An overview of Business Intelligence Technology, Communications of the ACM, 54(8), 88-98.
Index Terms

Computer Science
Information Sciences

Keywords

Real-Time Data Warehousing Real-Time ETL Data Stream Management Systems