- Aleksei Mashlakov ORCID:orcid.org/0000-0001-7370-380511,
- Ville Tikka ORCID:orcid.org/0000-0002-6395-337311,
- Lasse Lensu ORCID:orcid.org/0000-0002-7691-121X11,
- Aleksei Romanenko ORCID:orcid.org/0000-0003-0814-954X11 &
- …
- Samuli Honkapuro ORCID:orcid.org/0000-0001-8761-474X11
Part of the book series:Lecture Notes in Computer Science ((LNAI,volume 11804))
Included in the following conference series:
3079Accesses
10Citations
Abstract
In the past years, a rapid deployment of battery energy storage systems for diverse smart grid services has been seen in electric power systems. However, a cost-effective and multi-objective application of these services necessitates a utilization of forecasting methods for a development of efficient capacity allocation and risk management strategies over the uncertainty of battery state-of-charge. The aim of this paper is to assess the tuning efficiency of multi-attention recurrent neural network for multi-step forecasting of battery state-of-charge under provision of primary frequency control. In particular, this paper describes hyper-parameter optimization of the network with a tree-structured parzen estimator and compares such optimization performance with random and manual search on a simulated battery state-of-charge dataset. The experimental results demonstrate that the tree-structured parzen estimator enables 0.6% and 1.5% score improvement for the dataset compared with the random and manual search, respectively.
Supported by the DIGI-USER research platform of LUT University, Finland.
This is a preview of subscription content,log in via an institution to check access.
Access this chapter
Subscribe and save
- Get 10 units per month
- Download Article/Chapter or eBook
- 1 Unit = 1 Article or 1 Chapter
- Cancel anytime
Buy Now
- Chapter
- JPY 3498
- Price includes VAT (Japan)
- eBook
- JPY 11210
- Price includes VAT (Japan)
- Softcover Book
- JPY 14013
- Price includes VAT (Japan)
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Abadi, M., et al.: Tensorflow: a system for large-scale machine learning. In: 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 2016), pp. 265–283 (2016)
Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate. arXiv preprintarXiv:1409.0473 (2014)
Belonogova, N., et al.: Methodology to define a BESS operating strategy for the end-customer in the changing business environment. In: 2018 15th International Conference on the European Energy Market (EEM), pp. 1–6. IEEE (2018)
Bergstra, J., Bengio, Y.: Random search for hyper-parameter optimization. J. Mach. Learn. Res.13(Feb), 281–305 (2012)
Bergstra, J., Yamins, D., Cox, D.D.: Making a science of model search: hyperparameter optimization in hundreds of dimensions for vision architectures (2013)
Bergstra, J.S., Bardenet, R., Bengio, Y., Kégl, B.: Algorithms for hyper-parameter optimization. In: Advances in Neural Information Processing Systems, pp. 2546–2554 (2011)
Chollet, F., et al.: Keras (2015).https://keras.io
Chourey, D.R., Gupta, H., Kumar, A., Kumar, J., Kumar, A., Mishra, A.: Analyzing effect of system inertia on grid frequency forecasting using two stage neuro-fuzzy system. J. Inst. Eng. (India): Series B99(2), 125–136 (2018)
Dong, D., Sheng, Z., Yang, T.: Wind power prediction based on recurrent neural network with long short-term memory units. In: 2018 International Conference on Renewable Energy and Power Engineering (REPE), pp. 34–38. IEEE (2018)
Fitzgerald, G., Mandel, J., Morris, J., Touati, H.: The economics of battery energy storage: How multi-use, customer-sited batteries deliver the most services and value to customers and the grid. Rocky Mountain Institute, p. 6 (2015)
Hesse, H., Schimpe, M., Kucevic, D., Jossen, A.: Lithium-ion battery storage for the grid a review of stationary battery storage system design tailored for applications in modern power grids. Energies10(12), 2107 (2017)
Hyperopt: Distributed asynchronous hyperparameter optimization in Python. (2012).https://hyperopt.github.io/hyperopt/. Accessed 30 Apr 2019
Kong, W., Dong, Z.Y., Jia, Y., Hill, D.J., Xu, Y., Zhang, Y.: Short-term residential load forecasting based on LSTM recurrent neural network. IEEE Trans. Smart Grid10, 841–851 (2017)
Muhammad, A., Lee, J.M., Hong, S.W., Lee, S.J., Lee, E.H.: Deep learning application in power system with a case study on solar irradiation forecasting. In: 2019 International Conference on Artificial Intelligence in Information and Communication (ICAIIC), pp. 275–279. IEEE (2019)
Müller, M., et al.: Evaluation of grid-level adaptability for stationary battery energy storage system applications in Europe. J. Energy Storage9, 1–11 (2017)
Obaid, Z.A., Cipcigan, L.M., Abrahim, L., Muhssin, M.T.: Frequency control of future power systems: reviewing and evaluating challenges and new control methods. J. Modern Power Syst. Clean Energy7(1), 9–25 (2019)
Pedersen, M.E.H.: Hyper-parameter optimization (2018).https://github.com/Hvass-Labs/TensorFlow-Tutorials
Petneházi, G.: Recurrent neural networks for time series forecasting. arXiv preprintarXiv:1901.00069 (2019)
Pumperla, M.: Hyperas: a very simple convenience wrapper around hyperopt for fast prototyping with keras models (2017).https://maxpumperla.com/hyperas/. Accessed 30 Apr 2019
Ratsimbazafy, M.: McKinsey SmartCities traffic prediction (2018).https://github.com/mratsim/McKinsey-SmartCities-Traffic-Prediction
RTE: Continental Europe synchronous area frequency data metered by RTE (2019).https://clients.rte-france.com. Accessed 30 Apr 2019
Shi, H., Xu, M., Li, R.: Deep learning for household load forecasting–a novel pooling deep RNN. IEEE Trans. Smart Grid9(5), 5271–5280 (2018)
Sutskever, I., Vinyals, O., Le, Q.V.: Sequence to sequence learning with neural networks. In: Advances in Neural Information Processing Systems, pp. 3104–3112 (2014)
Toubeau, J.F., Bottieau, J., Vallée, F., De Grève, Z.: Deep learning-based multivariate probabilistic forecasting for short-term scheduling in power markets. IEEE Trans. Power Syst.34(2), 1203–1215 (2019)
Author information
Authors and Affiliations
LUT University, Yliopistonkatu 34, 53850, Lappeenranta, Finland
Aleksei Mashlakov, Ville Tikka, Lasse Lensu, Aleksei Romanenko & Samuli Honkapuro
- Aleksei Mashlakov
Search author on:PubMed Google Scholar
- Ville Tikka
Search author on:PubMed Google Scholar
- Lasse Lensu
Search author on:PubMed Google Scholar
- Aleksei Romanenko
Search author on:PubMed Google Scholar
- Samuli Honkapuro
Search author on:PubMed Google Scholar
Corresponding author
Correspondence toAleksei Mashlakov.
Editor information
Editors and Affiliations
INESC-TEC, University of Trás-os-Montes and Alto Douro, Vila Real, Portugal
Paulo Moura Oliveira
University of Minho, Braga, Portugal
Paulo Novais
LIACC/UP, University of Porto, Porto, Portugal
Luís Paulo Reis
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Mashlakov, A., Tikka, V., Lensu, L., Romanenko, A., Honkapuro, S. (2019). Hyper-parameter Optimization of Multi-attention Recurrent Neural Network for Battery State-of-Charge Forecasting. In: Moura Oliveira, P., Novais, P., Reis, L. (eds) Progress in Artificial Intelligence. EPIA 2019. Lecture Notes in Computer Science(), vol 11804. Springer, Cham. https://doi.org/10.1007/978-3-030-30241-2_41
Download citation
Published:
Publisher Name:Springer, Cham
Print ISBN:978-3-030-30240-5
Online ISBN:978-3-030-30241-2
eBook Packages:Computer ScienceComputer Science (R0)
Share this paper
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative