Skip to main content

Comparison of LSTM, GRU and Transformer Neural Network Architecture for Prediction of Wind Turbine Variables

  • Conference paper
  • First Online:
18th International Conference on Soft Computing Models in Industrial and Environmental Applications (SOCO 2023) (SOCO 2023)

Abstract

To deal with climate change and global warming, several countries have taken steps to reduce greenhouse gas emissions and have begun to switch to renewable energy sources. Wind energy is one of the most profitable and accessible technologies in this sense, and among the alternatives to manage its variability is prediction, which has become an increasingly popular topic in academia. Currently, there are several methods used for prediction, the methods based on artificial neural networks (RNA) are the ones that have aroused the greatest research interest. In this sense, this study presents the training of different ML algorithms, using deep learning models for the prediction of the power generated by a wind turbine. In addition, a new filtered signal is generated from the wind signal that is integrated into the set of input signals, obtaining better training performance. These models include long-short-term memory (LSTM), recurring rental unit (GRU) cells, and a Transformers-based model. The results referring to the trained models show that the technique that best fits time series I and time series II is GRU. This study also allows us to analyze different AI techniques to improve performance in wind farms.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Bashir, M.B.A.: Principle parameters and environmental impacts that affect the performance of wind turbine: an overview. Arab J. Sci. Eng. 47, 7891–7909 (2022)

    Article  Google Scholar 

  2. Roga, S., Bardhan, S., Kumar, Y., Dubey, S.K.: Recent technology and challenges of wind energy generation: a review. Sustain. Energy Technol. Assess. 52, 102239 (2022). https://doi.org/10.1016/j.seta.2022.102239

    Article  Google Scholar 

  3. Sotiropoulou, K.F., Vavatsikos, A.P.: Onshore wind farms GIS-assisted suitability analysis using PROMETHEE II. Energy Policy 158, 112531 (2021). https://doi.org/10.1016/j.enpol.2021.112531

    Article  Google Scholar 

  4. Ko, M.S., Lee, K., Kim, J.K., et al.: Deep concatenated residual network with bidirectional LSTM for one-hour-ahead wind power forecasting. IEEE Trans. Sustain. Energy 12, 1321–1335 (2021). https://doi.org/10.1109/TSTE.2020.3043884

    Article  Google Scholar 

  5. Liu, B., Zhao, S., Yu, X., et al.: A novel deep learning approach for wind power forecasting based on WD-LSTM model. Energies (Basel) 13, 4964 (2020). https://doi.org/10.3390/en13184964

    Article  Google Scholar 

  6. Wu, Q., Guan, F., Lv, C., Huang, Y.: Ultra-short-term multi-step wind power forecasting based on CNN-LSTM. IET Renew. Power Gener. 15, 1019–1029 (2021). https://doi.org/10.1049/rpg2.12085

    Article  Google Scholar 

  7. Shahid, F., Zameer, A., Muneeb, M.: A novel genetic LSTM model for wind power forecast. Energy 223, 120069 (2021). https://doi.org/10.1016/j.energy.2021.120069

    Article  Google Scholar 

  8. Li, C., Tang, G., Xue, X., et al.: Short-term wind speed interval prediction based on ensemble GRU model. IEEE Trans. Sustain. Energy 11, 1370–1380 (2020). https://doi.org/10.1109/TSTE.2019.2926147

    Article  Google Scholar 

  9. Sun, S., Liu, Y., Li, Q., et al.: Short-term multi-step wind power forecasting based on spatio-temporal correlations and transformer neural networks. Energy Convers. Manag. 283, 116916 (2023). https://doi.org/10.1016/j.enconman.2023.116916

    Article  Google Scholar 

  10. Wen, Q., Zhou, T., Zhang, C., et al.: Transformers in time series: a survey (2022). arXiv preprint arXiv:220207125

    Google Scholar 

  11. Phi, M.: Illustrated guide to LSTM’s and GRU’s: a step by step explanation. In: Towards Data Science (2018). https://towardsdatascience.com/illustrated-guide-to-lstms-and-gru-s-a-step-by-step-explanation-44e9eb85bf21. Accessed 1 Apr 2023

  12. Youness, M.: How to use transformer networks to build a forecasting model. In: Towards Data Science (2021). https://towardsdatascience.com/how-to-use-transformer-networks-to-build-a-forecasting-model-297f9270e630. Accessed 31 Mar 2023

  13. Albin-Ludvigsen, K.-G.: How to make a Transformer for time series forecasting with PyTorch. In: Towards Data Science (2022). https://towardsdatascience.com/how-to-make-a-pytorch-transformer-for-time-series-forecasting-69e073d4061e. Accessed 31 Mar 2023

  14. Wu, N., Green, B., Ben, X., O’Banion, S.: Deep transformer models for time series forecasting: the influenza prevalence case (2020). arXiv preprint arXiv:200108317

    Google Scholar 

  15. Erisen, B.: Wind turbine scada dataset. In: Kaggle (2018). https://www.kaggle.com/datasets/berkerisen/wind-turbine-scada-dataset/code. Accessed 3 Apr 2023

  16. Dobrev, P.: Texas wind turbine dataset - simulated. In: Kaggle (2022). https://www.kaggle.com/datasets/pravdomirdobrev/texas-wind-turbine-dataset-simulated

  17. Tensorflow. Time series forecasting. In: tensorflow.org (2022). https://www.tensorflow.org/tutorials/structured_data/time_series?hl=en. Accessed 13 Nov 2022

Download references

Acknowledgments

This work has been partially supported by the Spanish Ministry of Science and Innovation under the project MCI/AEI/FEDER number PID2021-123543OB-C21.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Pablo-Andrés Buestán-Andrade .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Buestán-Andrade, PA., Santos, M., Sierra-García, JE., Pazmiño-Piedra, JP. (2023). Comparison of LSTM, GRU and Transformer Neural Network Architecture for Prediction of Wind Turbine Variables. In: García Bringas, P., et al. 18th International Conference on Soft Computing Models in Industrial and Environmental Applications (SOCO 2023). SOCO 2023. Lecture Notes in Networks and Systems, vol 750. Springer, Cham. https://doi.org/10.1007/978-3-031-42536-3_32

Download citation

Publish with us

Policies and ethics