Movatterモバイル変換


[0]ホーム

URL:


Skip to main content

Advertisement

Springer Nature Link
Log in

Smoothing and stationarity enforcement framework for deep learning time-series forecasting

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Time-series analysis and forecasting problems are generally considered as some of the most challenging and complicated problems in data mining. In this work, we propose a new complete framework for enhancing deep learning time-series models, which is based on a data preprocessing methodology. The proposed framework focuses on conducting a sequence of transformations on the original low-quality time-series data for generating high-quality time-series data, “suitable” for efficiently training and fitting a deep learning model. These transformations are performed in two successive stages: The first stage is based on the smoothing technique for the development of a new de-noised version of the original series in which every value contains dynamic knowledge of the all previous values. The second stage of transformations is performed on the smoothed series and it is based on differencing the series in order to be stationary and be considerably easier fitted and analyzed by a deep learning model. A number of experiments were performed utilizing time-series datasets from the cryptocurrency market, energy sector and financial stock market application domains on both regression and classification problems. The comprehensive numerical experiments and statistical analysis provide empirical evidence that the proposed framework considerably improves the forecasting performance of a deep learning model.

This is a preview of subscription content,log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Japan)

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Weigend AS (2018) Time series prediction: forecasting the future and understanding the past. Routledge, London

    Book  Google Scholar 

  2. Brockwell Peter J, Brockwell Peter J, Davis Richard A, Davis Richard A (2016) Introduction to time series and forecasting. Springer, Berlin

    Book  Google Scholar 

  3. Berry Lindsay R, Paul H, Mike W (2019) Probabilistic forecasting of heterogeneous consumer transaction-sales time series. Int J Forecast 36:552

    Article  Google Scholar 

  4. Nunnari Giuseppe, Nunnari Valeria (2017) Forecasting monthly sales retail time series: a case study. In: 2017 IEEE 19th conference on business informatics (CBI), vol 1, pp 1–6. IEEE

  5. Rosales Enrique Benavides (2017) Time-series and cross-sectional momentum and contrarian strategies within the commodity futures markets. Cogent Econ Financ 5(1):1339772

    Article  Google Scholar 

  6. Livieris IE, Pintelas E, Kiriakidou N, Stavroyiannis S (2020) An advanced deep learning model for short-term forecasting U.S. natural gas price and movement. In: IFIP international conference on artificial intelligence applications and innovations. Springer, Berlin, pp 165–176

  7. Walter E (2008) Applied econometric time series. Wiley, New York

    Google Scholar 

  8. Pesaran Hashem M (2015) Time series and panel data econometrics. Oxford University Press, Oxford

    Book  Google Scholar 

  9. Box George EP, Jenkins Gwilym M, Reinsel Gregory C, Ljung Greta M (2015) Time series analysis: forecasting and control. Wiley, New York

    MATH  Google Scholar 

  10. Tsay Ruey S (2005) Analysis of financial time series, vol 543. Wiley, New York

    Book  Google Scholar 

  11. Livieris Ioannis E, Stavros S, Emmanuel P, Panagiotis P (2020) A novel validation framework to enhance deep learning models in time-series forecasting. Neural Comput Appl 32:17149

    Article  Google Scholar 

  12. Van Dick D, Timo T, Hans FP (2002) Smooth transition autoregressive models: a survey of recent developments. Econ Rev 21(1):1–47

    Article MathSciNet  Google Scholar 

  13. Hassler Uwe (2016) Autoregressive moving average processes (ARMA). In: Stochastic Processes and calculus. Springer, Berlin, pp 45–75

  14. Neusser K (2016) Autoregressive moving-average models. In: Time Series Econometrics. Springer, Berlin, pp 25–44

  15. Chirag D, Fan Z, Junjing Y, Eang LS, Wei SK (2017) A review on time series forecasting techniques for building energy consumption. Renew Sustain Energy Rev 74:902–924

    Article  Google Scholar 

  16. Trevor F, Christophe M (2016) An empirical comparison of classification algorithms for mortgage default prediction: evidence from a distressed mortgage market. Eur J Oper Res 249(2):427–439

    Article MathSciNet  Google Scholar 

  17. Livieris IE, Kotsilieris T, Stavroyiannis S, Pintelas P (2019) Forecasting stock price index movement using a constrained deep neural network training algorithm. Intell Dec Technol, (Preprint):1–11

  18. Pintelas E, Livieris IE, Stavroyiannis S, Kotsilieris T, Pintelas P (2020) Investigating the problem of cryptocurrency price prediction—a deep learning approach. In: IFIP International conference on artificial intelligence applications and innovations. Springer, Berlin, pp 99–110

  19. Chowdhury R, Rahman MA, Rahman MS, Mahdy MRC (2019) Predicting and forecasting the price of constituents and index of cryptocurrency using machine learning. arXiv preprint arXiv:1905.08444

  20. Zhongpei C, Jun W (2018) Forecasting neural network model with novel CID learning rate and EEMD algorithms on energy market. Neurocomputing 317:168–178

    Article  Google Scholar 

  21. Xuerong L, Wei S, Shouyang W (2019) Text-based crude oil price forecasting: A deep learning approach. Int J Forecast 35(4):1548–1560

    Article  Google Scholar 

  22. Fabbri M, Moro G (2018) Dow Jones trading with deep learning: The unreasonable effectiveness of recurrent neural networks. In: Proceedings of the 7th international conference on data science, technology and applications, pp 142–153

  23. Site A, Birant D, Işık Z Stock market forecasting using machine learning models. In: 2019 Innovations in intelligent systems and applications conference (ASYU), IEEE, pp 1–6

  24. Hyndman RJ, Athanasopoulos G (2018) Forecasting: principles and practice

  25. Montgomery Douglas C, Jennings Cheryl L, Murat Kulahci (2015) Introduction to time series analysis and forecasting. Wiley, New York

    MATH  Google Scholar 

  26. Kingma DP, Adam JB (2015) A method for stochastic optimization. In: 2015 International conference on learning representations

  27. Hodges Joseph L, Lehmann Erich L (1962) Rank methods for combination of independent experiments in analysis of variance. Ann Math Stat 33(2):482–497

    Article MathSciNet  Google Scholar 

  28. Helmut F (1993) On a monotonicity problem in step-down multiple test procedures. J Am Stat Assoc 88(423):920–923

    Article MathSciNet  Google Scholar 

  29. Bergstra J, Bardenet R, Bengio Y, Kégl B (2011)Algorithms for hyper-parameter optimization. In: 25th annual conference on neural information processing systems (NIPS 2011), vol 24. Neural Information Processing Systems Foundation

  30. James B, Yoshua B (2012) Random search for hyper-parameter optimization. J Machine Learn Res 13:2

    MathSciNet MATH  Google Scholar 

  31. Vladimir S, Novak N (2016) A nature inspired parameter tuning approach to cascade control for hydraulically driven parallel robot platform. J Optim Theory Appl 168(1):332–347

    Article MathSciNet  Google Scholar 

  32. Ziran C, Baoyong Z, Vladimir S, Yijun Z, Zhengqiang Z (2020) Event-based fuzzy control for ts fuzzy networked systems with various data missing. Neurocomputing 417:322–332

    Article  Google Scholar 

  33. Xuefei D, Shuping H, Vladimir S (2020) Robust fault detection filter design for a class of discrete-time conic-type non-linear markov jump systems with jump fault signals. IET Control Theory Appl 14(14):1912–1919

    Article  Google Scholar 

  34. Vladimir S, Dragan P (2020) Robust identification for fault detection in the presence of non-gaussian noises: application to hydraulic servo drives. Nonlinear Dyn 100:2299–2313

    Article  Google Scholar 

  35. Hongfeng T, Peng W, Yiyang C, Vladimir S, Huizhong Y (2020) An unsupervised fault diagnosis method for rolling bearing using STFT and generative neural networks. J Frank Inst 357(11):7286–7307

    Article MathSciNet  Google Scholar 

  36. Izonin I, Tkachenko R, Vitynskyi P, Zub K, Tkachenko P, Dronyuk I (2020) Stacking-based GRNN-SGTM ensemble model for prediction tasks. In: 2020 International conference on decision aid sciences and application (DASA), pp 326–330. IEEE

  37. Panagiotis M, Mattheou K, Alex K (2010) Forecasting ARMA models: a comparative study of information criteria focusing on MDIC. J Stat Comput Simulat 80(1):61–73

    Article MathSciNet  Google Scholar 

  38. Roman T, Ivan I, Natalia K, Ivanna D, Khrystyna Z (2020) An approach towards increasing prediction accuracy for the recovery of missing IoT data based on the GRNN-SGTM ensemble. Sensors 20(9):2625

    Article  Google Scholar 

  39. Vitynskyi P, Tkachenko R, Izonin I, Kutucu H (2018) Hybridization of the SGTM neural-like structure through inputs polynomial extension. In: 2018 IEEE Second International Conference on Data Stream Mining & Processing (DSMP), pp 386–391. IEEE

  40. Tay Y, Tuan LA, Hui SC (2018) Multi-cast attention networks. In: Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, pp 2299–2308

  41. Konstantinos D, Dimitrios T, Lykourgos M (2020) Modeling and forecasting the COVID-19 temporal spread in Greece: an exploratory approach based on complex network defined splines. Int J Environ Res Public Health 17:4693

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Mathematics, University of Patras, Patras, 265-00, Greece

    Ioannis E. Livieris & Panagiotis Pintelas

  2. Department of Accounting and Finance, University of the Peloponnese, Antikalamos, 241-00, Greece

    Stavros Stavroyiannis

  3. Department of Civil Engineering, Democritus University of Thrace, Xanthi, 671-00, Greece

    Lazaros Iliadis

Authors
  1. Ioannis E. Livieris

    You can also search for this author inPubMed Google Scholar

  2. Stavros Stavroyiannis

    You can also search for this author inPubMed Google Scholar

  3. Lazaros Iliadis

    You can also search for this author inPubMed Google Scholar

  4. Panagiotis Pintelas

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence toIoannis E. Livieris.

Ethics declarations

Conflict of interest

The author declared no potential conflicts of interest with respect to the research, authorship and/or publication of this article.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Livieris, I.E., Stavroyiannis, S., Iliadis, L.et al. Smoothing and stationarity enforcement framework for deep learning time-series forecasting.Neural Comput & Applic33, 14021–14035 (2021). https://doi.org/10.1007/s00521-021-06043-1

Download citation

Keywords

Access this article

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Japan)

Instant access to the full article PDF.

Advertisement


[8]ページ先頭

©2009-2025 Movatter.jp