- Ioannis E. Livieris ORCID:orcid.org/0000-0002-3996-33011,
- Stavros Stavroyiannis2,
- Lazaros Iliadis3 &
- …
- Panagiotis Pintelas1
4821Accesses
24Citations
Abstract
Time-series analysis and forecasting problems are generally considered as some of the most challenging and complicated problems in data mining. In this work, we propose a new complete framework for enhancing deep learning time-series models, which is based on a data preprocessing methodology. The proposed framework focuses on conducting a sequence of transformations on the original low-quality time-series data for generating high-quality time-series data, “suitable” for efficiently training and fitting a deep learning model. These transformations are performed in two successive stages: The first stage is based on the smoothing technique for the development of a new de-noised version of the original series in which every value contains dynamic knowledge of the all previous values. The second stage of transformations is performed on the smoothed series and it is based on differencing the series in order to be stationary and be considerably easier fitted and analyzed by a deep learning model. A number of experiments were performed utilizing time-series datasets from the cryptocurrency market, energy sector and financial stock market application domains on both regression and classification problems. The comprehensive numerical experiments and statistical analysis provide empirical evidence that the proposed framework considerably improves the forecasting performance of a deep learning model.
This is a preview of subscription content,log in via an institution to check access.
Access this article
Subscribe and save
- Get 10 units per month
- Download Article/Chapter or eBook
- 1 Unit = 1 Article or 1 Chapter
- Cancel anytime
Buy Now
Price includes VAT (Japan)
Instant access to the full article PDF.

Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Weigend AS (2018) Time series prediction: forecasting the future and understanding the past. Routledge, London
Brockwell Peter J, Brockwell Peter J, Davis Richard A, Davis Richard A (2016) Introduction to time series and forecasting. Springer, Berlin
Berry Lindsay R, Paul H, Mike W (2019) Probabilistic forecasting of heterogeneous consumer transaction-sales time series. Int J Forecast 36:552
Nunnari Giuseppe, Nunnari Valeria (2017) Forecasting monthly sales retail time series: a case study. In: 2017 IEEE 19th conference on business informatics (CBI), vol 1, pp 1–6. IEEE
Rosales Enrique Benavides (2017) Time-series and cross-sectional momentum and contrarian strategies within the commodity futures markets. Cogent Econ Financ 5(1):1339772
Livieris IE, Pintelas E, Kiriakidou N, Stavroyiannis S (2020) An advanced deep learning model for short-term forecasting U.S. natural gas price and movement. In: IFIP international conference on artificial intelligence applications and innovations. Springer, Berlin, pp 165–176
Walter E (2008) Applied econometric time series. Wiley, New York
Pesaran Hashem M (2015) Time series and panel data econometrics. Oxford University Press, Oxford
Box George EP, Jenkins Gwilym M, Reinsel Gregory C, Ljung Greta M (2015) Time series analysis: forecasting and control. Wiley, New York
Tsay Ruey S (2005) Analysis of financial time series, vol 543. Wiley, New York
Livieris Ioannis E, Stavros S, Emmanuel P, Panagiotis P (2020) A novel validation framework to enhance deep learning models in time-series forecasting. Neural Comput Appl 32:17149
Van Dick D, Timo T, Hans FP (2002) Smooth transition autoregressive models: a survey of recent developments. Econ Rev 21(1):1–47
Hassler Uwe (2016) Autoregressive moving average processes (ARMA). In: Stochastic Processes and calculus. Springer, Berlin, pp 45–75
Neusser K (2016) Autoregressive moving-average models. In: Time Series Econometrics. Springer, Berlin, pp 25–44
Chirag D, Fan Z, Junjing Y, Eang LS, Wei SK (2017) A review on time series forecasting techniques for building energy consumption. Renew Sustain Energy Rev 74:902–924
Trevor F, Christophe M (2016) An empirical comparison of classification algorithms for mortgage default prediction: evidence from a distressed mortgage market. Eur J Oper Res 249(2):427–439
Livieris IE, Kotsilieris T, Stavroyiannis S, Pintelas P (2019) Forecasting stock price index movement using a constrained deep neural network training algorithm. Intell Dec Technol, (Preprint):1–11
Pintelas E, Livieris IE, Stavroyiannis S, Kotsilieris T, Pintelas P (2020) Investigating the problem of cryptocurrency price prediction—a deep learning approach. In: IFIP International conference on artificial intelligence applications and innovations. Springer, Berlin, pp 99–110
Chowdhury R, Rahman MA, Rahman MS, Mahdy MRC (2019) Predicting and forecasting the price of constituents and index of cryptocurrency using machine learning. arXiv preprint arXiv:1905.08444
Zhongpei C, Jun W (2018) Forecasting neural network model with novel CID learning rate and EEMD algorithms on energy market. Neurocomputing 317:168–178
Xuerong L, Wei S, Shouyang W (2019) Text-based crude oil price forecasting: A deep learning approach. Int J Forecast 35(4):1548–1560
Fabbri M, Moro G (2018) Dow Jones trading with deep learning: The unreasonable effectiveness of recurrent neural networks. In: Proceedings of the 7th international conference on data science, technology and applications, pp 142–153
Site A, Birant D, Işık Z Stock market forecasting using machine learning models. In: 2019 Innovations in intelligent systems and applications conference (ASYU), IEEE, pp 1–6
Hyndman RJ, Athanasopoulos G (2018) Forecasting: principles and practice
Montgomery Douglas C, Jennings Cheryl L, Murat Kulahci (2015) Introduction to time series analysis and forecasting. Wiley, New York
Kingma DP, Adam JB (2015) A method for stochastic optimization. In: 2015 International conference on learning representations
Hodges Joseph L, Lehmann Erich L (1962) Rank methods for combination of independent experiments in analysis of variance. Ann Math Stat 33(2):482–497
Helmut F (1993) On a monotonicity problem in step-down multiple test procedures. J Am Stat Assoc 88(423):920–923
Bergstra J, Bardenet R, Bengio Y, Kégl B (2011)Algorithms for hyper-parameter optimization. In: 25th annual conference on neural information processing systems (NIPS 2011), vol 24. Neural Information Processing Systems Foundation
James B, Yoshua B (2012) Random search for hyper-parameter optimization. J Machine Learn Res 13:2
Vladimir S, Novak N (2016) A nature inspired parameter tuning approach to cascade control for hydraulically driven parallel robot platform. J Optim Theory Appl 168(1):332–347
Ziran C, Baoyong Z, Vladimir S, Yijun Z, Zhengqiang Z (2020) Event-based fuzzy control for ts fuzzy networked systems with various data missing. Neurocomputing 417:322–332
Xuefei D, Shuping H, Vladimir S (2020) Robust fault detection filter design for a class of discrete-time conic-type non-linear markov jump systems with jump fault signals. IET Control Theory Appl 14(14):1912–1919
Vladimir S, Dragan P (2020) Robust identification for fault detection in the presence of non-gaussian noises: application to hydraulic servo drives. Nonlinear Dyn 100:2299–2313
Hongfeng T, Peng W, Yiyang C, Vladimir S, Huizhong Y (2020) An unsupervised fault diagnosis method for rolling bearing using STFT and generative neural networks. J Frank Inst 357(11):7286–7307
Izonin I, Tkachenko R, Vitynskyi P, Zub K, Tkachenko P, Dronyuk I (2020) Stacking-based GRNN-SGTM ensemble model for prediction tasks. In: 2020 International conference on decision aid sciences and application (DASA), pp 326–330. IEEE
Panagiotis M, Mattheou K, Alex K (2010) Forecasting ARMA models: a comparative study of information criteria focusing on MDIC. J Stat Comput Simulat 80(1):61–73
Roman T, Ivan I, Natalia K, Ivanna D, Khrystyna Z (2020) An approach towards increasing prediction accuracy for the recovery of missing IoT data based on the GRNN-SGTM ensemble. Sensors 20(9):2625
Vitynskyi P, Tkachenko R, Izonin I, Kutucu H (2018) Hybridization of the SGTM neural-like structure through inputs polynomial extension. In: 2018 IEEE Second International Conference on Data Stream Mining & Processing (DSMP), pp 386–391. IEEE
Tay Y, Tuan LA, Hui SC (2018) Multi-cast attention networks. In: Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, pp 2299–2308
Konstantinos D, Dimitrios T, Lykourgos M (2020) Modeling and forecasting the COVID-19 temporal spread in Greece: an exploratory approach based on complex network defined splines. Int J Environ Res Public Health 17:4693
Author information
Authors and Affiliations
Department of Mathematics, University of Patras, Patras, 265-00, Greece
Ioannis E. Livieris & Panagiotis Pintelas
Department of Accounting and Finance, University of the Peloponnese, Antikalamos, 241-00, Greece
Stavros Stavroyiannis
Department of Civil Engineering, Democritus University of Thrace, Xanthi, 671-00, Greece
Lazaros Iliadis
- Ioannis E. Livieris
You can also search for this author inPubMed Google Scholar
- Stavros Stavroyiannis
You can also search for this author inPubMed Google Scholar
- Lazaros Iliadis
You can also search for this author inPubMed Google Scholar
- Panagiotis Pintelas
You can also search for this author inPubMed Google Scholar
Corresponding author
Correspondence toIoannis E. Livieris.
Ethics declarations
Conflict of interest
The author declared no potential conflicts of interest with respect to the research, authorship and/or publication of this article.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Livieris, I.E., Stavroyiannis, S., Iliadis, L.et al. Smoothing and stationarity enforcement framework for deep learning time-series forecasting.Neural Comput & Applic33, 14021–14035 (2021). https://doi.org/10.1007/s00521-021-06043-1
Received:
Accepted:
Published:
Issue Date:
Share this article
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative