Movatterモバイル変換


[0]ホーム

URL:


Skip to main content

Advertisement

Springer Nature Link
Log in

An ETL Strategy for Real-Time Data Warehouse

  • Conference paper

Part of the book series:Advances in Intelligent and Soft Computing ((AINSC,volume 124))

  • 2629Accesses

  • 10Citations

Abstract

Real-time data warehouse as an extension of traditional data warehouse, it is effectively shortening the delay of information and providing timely and accurate decision support to decision makers. The ETL processing is the core technology of data warehouse, especially in real-time data warehouse. This paper is analyzing the current mainstream technology for real-time ETL. We propose a way to capture changed data which is based on log analysis and log listening. This method provides an effective solution for the huge amount of data, which greatly improve system performance.

This is a preview of subscription content,log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
JPY 3498
Price includes VAT (Japan)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
JPY 51479
Price includes VAT (Japan)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
JPY 64349
Price includes VAT (Japan)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide -see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. J. Langseth. Real-Time Data Warehousing: Challenges and Solutions [DB/OL],http://DSSResources.COM (April 06, 2008)

  2. Davis, J.R.: Right-time Business Intelligence: Optimizing the Business Decision Cycle. B-EYE-Netword.com (2006)

    Google Scholar 

  3. Inmon, W.H., Wang, Z.-H.: Data warehouse, The original book 4th edn. Machinery Industry Press, Beijing (2006)

    Google Scholar 

  4. Bin, G., Jianhua, G., et al.: ESB-based real-time ETL systems. Design and Implementation of Computer Applications (2008)

    Google Scholar 

  5. Yu, L., Yang, D.-Q., et al.: Real-time active data warehouse for real-time demand data integration method. Computer Research and Development (2007)

    Google Scholar 

  6. Li, Q.-Z., Zhang, K., Yang, S.-J.: Regulation for the Replacement, a data warehouse initiative to update the way. System Simulation Technology (2003)

    Google Scholar 

  7. Kimball, R., Ross, M.: The Data Warehouse Toolkit. John Wiley & Sons (2002)

    Google Scholar 

  8. Codd, E.F., Codd, S.B., Salley, C.T.: Providing OLAP to User Analysts: An IT Mandate. Codd & Date, Inc. (1993)

    Google Scholar 

  9. Plattner, H.: A Common Database Approach for OLTP and OLAP Using an In-Memory Column Database. In: SIGMOD 2009 (2009)

    Google Scholar 

  10. Thalhammer, T., Schrefl, M., et al.: Active data warehouses: complementing OLAP with analysis rules. Data & Knowledge Engineering 39(3), 241–269 (2001)

    Article MATH  Google Scholar 

  11. Rizzi, S., Abelló, A., Lechtenbörger, J., Trujillo, J.: Research in Data Warehouse Modeling and Design: Dead or Alive? In: ACM DOLAP 2006, pp. 3–10 (2006)

    Google Scholar 

  12. March, S.T., Hevner, A.R.: Integrated decision support systems: A data warehousing perspective. Decision Support Systems 43, 1031–1043 (2007)

    Article  Google Scholar 

  13. Zimmer, D., Unland, R.: On the Semantics of Complex Events in Active Database Management Systems. In: 15th International Conference on Data Engineering (ICDE 1999), p. 392 (1999)

    Google Scholar 

  14. Pardillo, J., Mazón, J.-N., Trujillo, J.: Model-Driven Metadata for OLAP Cubes from the Conceptual Modelling of Data Warehouses. In: Song, I.-Y., Eder, J., Nguyen, T.M. (eds.) DaWaK 2008. LNCS, vol. 5182, pp. 13–22. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  15. Santos, R.J., Bernardino, J.: Real-Time Data Warehouse Loading Methodology. In: ACM IDEAS 2008, September 10-12, pp. 49–58 (2008)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer, College of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, China

    Haihe Zhou & Yang Xu

  2. Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai, China

    Dingyu Yang

Authors
  1. Haihe Zhou
  2. Dingyu Yang
  3. Yang Xu

Editor information

Editors and Affiliations

  1. Department of Computer Science and Engineering, Shanghai Jiao Tong University, 800 Dongchuan Road, 200240, Shanghai, China

    Yinglin Wang

  2. School of Information Science and Technology, Southwest Jiaotong University, 610031, Chengdu, Sichuan Province, China

    Tianrui Li

Rights and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Zhou, H., Yang, D., Xu, Y. (2011). An ETL Strategy for Real-Time Data Warehouse. In: Wang, Y., Li, T. (eds) Practical Applications of Intelligent Systems. Advances in Intelligent and Soft Computing, vol 124. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25658-5_41

Download citation

Publish with us

Access this chapter

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
JPY 3498
Price includes VAT (Japan)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
JPY 51479
Price includes VAT (Japan)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
JPY 64349
Price includes VAT (Japan)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide -see info

Tax calculation will be finalised at checkout

Purchases are for personal use only


[8]ページ先頭

©2009-2025 Movatter.jp