Skip to main content

A Domain Adaptation Deep Learning Network for EEG-Based Motor Imagery Classification

  • Conference paper
  • First Online:
Applied Intelligence (ICAI 2023)

Abstract

The correlation between neighboring electroencephalography (EEG) channels reveals brain signal interconnectedness, and how to represent this correlation is being studied. Simultaneously, variations in EEG signals among individuals may present difficulties in the model’s ability to generalize across different individuals. A model may perform well on one person but not on others, limiting its reliability and generalizability in practical applications. We propose a domain adaptation-based deep learning network to address the issues above. Initially, the EEG data is transformed into a three-dimensional (3D) matrix to preserve the correlation between EEG channels, and subsequently, the spatial-temporal characteristics of the data are acquired by using the 3D convolution module. The spatial-feature map attention mechanism reinforces spatial features in the feature map, allowing the subsequent convolution module to learn spatial feature information. Finally, a domain adaptation strategy is employed for both single-source and multi-source domain scenarios. The objective of this strategy is to address the issue of variability in the EEG signal by minimizing the discrepancy between the source and target domains using a maximum mean discrepancy loss function. The proposed method was validated on two datasets, namely the BCIC IV 2a and OpenBMI datasets. We achieved an accuracy of 70.42% in an intra-subject OpenBMI experiment, which is 5.51% higher than the state-of-the-art approach. On the BCIC IV 2a dataset, we conducted intra-subject and inter-subject experiments, achieving accuracy results of 73.91% and 67.88%, respectively, which are 5.38% and 1.61% better than the state-of-the-art method.

J. Jiao and Y. Pan—contribute equally to this work.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 64.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 84.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Kwak, Y., Kong, K., Song, W.J., Kim, S.E.: Subject-invariant deep neural networks based on baseline correction for EEG motor imagery BCI. IEEE J. Biomed. Health Inform. 27(4), 1801–1812 (2023)

    Article  Google Scholar 

  2. Zhang, Y., Ding, W.: Motor imagery classification via stacking-based takagi–sugeno–kang fuzzy classifier ensemble. Knowl.-Based Syst. 263, 110292 (2023)

    Article  Google Scholar 

  3. Ai, J., Meng, J., Mai, X., Zhu, X.: Bci control of a robotic arm based on ssvep with moving stimuli for reach and grasp tasks. IEEE J. Biomed. Health Inform. (2023)

    Google Scholar 

  4. Al-Qazzaz, N.K., Alyasseri, Z.A.A., Abdulkareem, K.H., Ali, N.S., Al-Mhiqani, M.N., Guger, C.: EEG feature fusion for motor imagery: a new robust framework towards stroke patients rehabilitation. Comput. Biol. Med. 137, 104799 (2021)

    Article  Google Scholar 

  5. Amini, M.M., Shalchyan, V.: Designing a motion-onset visual evoked potential-based brain-computer interface to control a computer game. IEEE Trans. Games (2023)

    Google Scholar 

  6. Fang, H., Jin, J., Daly, I., Wang, X.: Feature extraction method based on filter banks and riemannian tangent space in motor-imagery BCI. IEEE J. Biomed. Health Inform. 26(6), 2504–2514 (2022)

    Article  Google Scholar 

  7. Ko, L.W., et al.: Multimodal fuzzy fusion for enhancing the motor-imagery-based brain computer interface. IEEE Comput. Intell. Mag. 14(1), 96–106 (2019)

    Article  Google Scholar 

  8. Zhu, H., Forenzo, D., He, B.: On the deep learning models for EEG-based brain-computer interface using motor imagery. IEEE Trans. Neural Syst. Rehabil. Eng. 30, 2283–2291 (2022)

    Article  Google Scholar 

  9. Lawhern, V.J., Solon, A.J., Waytowich, N.R., Gordon, S.M., Hung, C.P., Lance, B.J.: EEGNet: a compact convolutional neural network for EEG-based brain-computer interfaces. J. Neural Eng. 15(5), 056013 (2018)

    Article  Google Scholar 

  10. Mane, R., et al.: FBCNet: a multi-view convolutional neural network for brain-computer interface. arXiv preprint, 2104.01233 (2021)

    Google Scholar 

  11. Gao, D., Wang, K., Wang, M., Zhou, J., Zhang, Y.: SFT-net: a network for detecting fatigue from EEG signals by combining 4d feature flow and attention mechanism. IEEE J. Biomed. Health Inform. (2023)

    Google Scholar 

  12. Zhao, X., Zhang, H., Zhu, G., You, F., Kuang, S., Sun, L.: A multi-branch 3D convolutional neural network for EEG-based motor imagery classification. IEEE Trans. Neural Syst. Rehabil. Eng. 27(10), 2164–2177 (2019)

    Article  Google Scholar 

  13. Chen, D., et al.: Scalp EEG-based pain detection using convolutional neural network. IEEE Trans. Neural Syst. Rehabil. Eng. 30, 274–285 (2022)

    Article  Google Scholar 

  14. Cui, J., Lan, Z., Sourina, O., Müller-Wittig, W.: EEG-based cross-subject driver drowsiness recognition with an interpretable convolutional neural network. IEEE Trans. Neural Networks Learn. Syst. (2022)

    Google Scholar 

  15. Zhang, X., Miao, Z., Menon, C., Zheng, Y., Zhao, M., Ming, D.: Priming cross-session motor imagery classification with a universal deep domain adaptation framework. Neurocomputing 556, 126659 (2023)

    Article  Google Scholar 

  16. Zhang, D., Chen, K., Jian, D., Yao, L.: Motor imagery classification via temporal attention cues of graph embedded EEG signals. IEEE J. Biomed. Health Inform. 24(9), 2570–2579 (2020)

    Article  Google Scholar 

  17. Altaheri, H., Muhammad, G., Alsulaiman, M.: Dynamic convolution with multi-level attention for eeg-based motor imagery decoding. IEEE Internet Things J. 1 (2023)

    Google Scholar 

  18. Li, A., Wang, Z., Zhao, X., Xu, T., Zhou, T., Hu, H.: MDTL: a novel and model-agnostic transfer learning strategy for cross-subject motor imagery BCI. IEEE Trans. Neural Syst. Rehabil. Eng. 31, 1743–1753 (2023)

    Article  Google Scholar 

  19. Jia, Z., Lin, Y., Cai, X., Chen, H., Gou, H., Wang, J.: Sst-emotionnet: spatial-spectral-temporal based attention 3d dense network for EEG emotion recognition. In: Proceedings of the 28th ACM International Conference on Multimedia. pp. 2909–2917 (2020)

    Google Scholar 

  20. Hu, J., Shen, L., Sun, G.: Squeeze-and-excitation networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7132–7141 (2018)

    Google Scholar 

  21. Lee, M.H., et al.: EEG dataset and OpenBMI toolbox for three BCI paradigms: An investigation into BCI illiteracy. GigaScience 8(5), giz002 (2019)

    Google Scholar 

  22. Tangermann, M., et al.: Review of the BCI competition IV. Front. Neurosci. p. 55 (2012)

    Google Scholar 

  23. Autthasan, P., et al.: Min2net: end-to-end multi-task learning for subject-independent motor imagery EEG classification. IEEE Trans. Biomed. Eng. 69(6), 2105–2118 (2021)

    Google Scholar 

  24. Zhang, K., Robinson, N., Lee, S.W., Guan, C.: Adaptive transfer learning for EEG motor imagery classification with deep convolutional neural network. Neural Netw. 136, 1–10 (2021)

    Article  Google Scholar 

  25. Schirrmeister, R.T., et al.: Deep learning with convolutional neural networks for EEG decoding and visualization. Hum. Brain Mapp. 38(11), 5391–5420 (2017)

    Article  Google Scholar 

Download references

Acknowledgment

This research was supported by the Fujian Provincial Natural Science Foundation (Grant No. 2023J01921), the Fujian Provincial Young and Middle-aged Teachers' Education Research Project (Grant No. JAT210265), the Young Tech Innovation Leading Talent Program of Ningbo City (Grant No. 2023QL008), and the Innovation Consortium Program for Green and Efficient Intelligent Appliances of Ningbo City (Grant No. 2022H002).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Meiyan Xu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Jiao, J. et al. (2024). A Domain Adaptation Deep Learning Network for EEG-Based Motor Imagery Classification. In: Huang, DS., Premaratne, P., Yuan, C. (eds) Applied Intelligence. ICAI 2023. Communications in Computer and Information Science, vol 2014. Springer, Singapore. https://doi.org/10.1007/978-981-97-0903-8_11

Download citation

  • DOI: https://doi.org/10.1007/978-981-97-0903-8_11

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-97-0902-1

  • Online ISBN: 978-981-97-0903-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics