Abstract
The correlation between neighboring electroencephalography (EEG) channels reveals brain signal interconnectedness, and how to represent this correlation is being studied. Simultaneously, variations in EEG signals among individuals may present difficulties in the model’s ability to generalize across different individuals. A model may perform well on one person but not on others, limiting its reliability and generalizability in practical applications. We propose a domain adaptation-based deep learning network to address the issues above. Initially, the EEG data is transformed into a three-dimensional (3D) matrix to preserve the correlation between EEG channels, and subsequently, the spatial-temporal characteristics of the data are acquired by using the 3D convolution module. The spatial-feature map attention mechanism reinforces spatial features in the feature map, allowing the subsequent convolution module to learn spatial feature information. Finally, a domain adaptation strategy is employed for both single-source and multi-source domain scenarios. The objective of this strategy is to address the issue of variability in the EEG signal by minimizing the discrepancy between the source and target domains using a maximum mean discrepancy loss function. The proposed method was validated on two datasets, namely the BCIC IV 2a and OpenBMI datasets. We achieved an accuracy of 70.42% in an intra-subject OpenBMI experiment, which is 5.51% higher than the state-of-the-art approach. On the BCIC IV 2a dataset, we conducted intra-subject and inter-subject experiments, achieving accuracy results of 73.91% and 67.88%, respectively, which are 5.38% and 1.61% better than the state-of-the-art method.
J. Jiao and Y. Pan—contribute equally to this work.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Kwak, Y., Kong, K., Song, W.J., Kim, S.E.: Subject-invariant deep neural networks based on baseline correction for EEG motor imagery BCI. IEEE J. Biomed. Health Inform. 27(4), 1801–1812 (2023)
Zhang, Y., Ding, W.: Motor imagery classification via stacking-based takagi–sugeno–kang fuzzy classifier ensemble. Knowl.-Based Syst. 263, 110292 (2023)
Ai, J., Meng, J., Mai, X., Zhu, X.: Bci control of a robotic arm based on ssvep with moving stimuli for reach and grasp tasks. IEEE J. Biomed. Health Inform. (2023)
Al-Qazzaz, N.K., Alyasseri, Z.A.A., Abdulkareem, K.H., Ali, N.S., Al-Mhiqani, M.N., Guger, C.: EEG feature fusion for motor imagery: a new robust framework towards stroke patients rehabilitation. Comput. Biol. Med. 137, 104799 (2021)
Amini, M.M., Shalchyan, V.: Designing a motion-onset visual evoked potential-based brain-computer interface to control a computer game. IEEE Trans. Games (2023)
Fang, H., Jin, J., Daly, I., Wang, X.: Feature extraction method based on filter banks and riemannian tangent space in motor-imagery BCI. IEEE J. Biomed. Health Inform. 26(6), 2504–2514 (2022)
Ko, L.W., et al.: Multimodal fuzzy fusion for enhancing the motor-imagery-based brain computer interface. IEEE Comput. Intell. Mag. 14(1), 96–106 (2019)
Zhu, H., Forenzo, D., He, B.: On the deep learning models for EEG-based brain-computer interface using motor imagery. IEEE Trans. Neural Syst. Rehabil. Eng. 30, 2283–2291 (2022)
Lawhern, V.J., Solon, A.J., Waytowich, N.R., Gordon, S.M., Hung, C.P., Lance, B.J.: EEGNet: a compact convolutional neural network for EEG-based brain-computer interfaces. J. Neural Eng. 15(5), 056013 (2018)
Mane, R., et al.: FBCNet: a multi-view convolutional neural network for brain-computer interface. arXiv preprint, 2104.01233 (2021)
Gao, D., Wang, K., Wang, M., Zhou, J., Zhang, Y.: SFT-net: a network for detecting fatigue from EEG signals by combining 4d feature flow and attention mechanism. IEEE J. Biomed. Health Inform. (2023)
Zhao, X., Zhang, H., Zhu, G., You, F., Kuang, S., Sun, L.: A multi-branch 3D convolutional neural network for EEG-based motor imagery classification. IEEE Trans. Neural Syst. Rehabil. Eng. 27(10), 2164–2177 (2019)
Chen, D., et al.: Scalp EEG-based pain detection using convolutional neural network. IEEE Trans. Neural Syst. Rehabil. Eng. 30, 274–285 (2022)
Cui, J., Lan, Z., Sourina, O., Müller-Wittig, W.: EEG-based cross-subject driver drowsiness recognition with an interpretable convolutional neural network. IEEE Trans. Neural Networks Learn. Syst. (2022)
Zhang, X., Miao, Z., Menon, C., Zheng, Y., Zhao, M., Ming, D.: Priming cross-session motor imagery classification with a universal deep domain adaptation framework. Neurocomputing 556, 126659 (2023)
Zhang, D., Chen, K., Jian, D., Yao, L.: Motor imagery classification via temporal attention cues of graph embedded EEG signals. IEEE J. Biomed. Health Inform. 24(9), 2570–2579 (2020)
Altaheri, H., Muhammad, G., Alsulaiman, M.: Dynamic convolution with multi-level attention for eeg-based motor imagery decoding. IEEE Internet Things J. 1 (2023)
Li, A., Wang, Z., Zhao, X., Xu, T., Zhou, T., Hu, H.: MDTL: a novel and model-agnostic transfer learning strategy for cross-subject motor imagery BCI. IEEE Trans. Neural Syst. Rehabil. Eng. 31, 1743–1753 (2023)
Jia, Z., Lin, Y., Cai, X., Chen, H., Gou, H., Wang, J.: Sst-emotionnet: spatial-spectral-temporal based attention 3d dense network for EEG emotion recognition. In: Proceedings of the 28th ACM International Conference on Multimedia. pp. 2909–2917 (2020)
Hu, J., Shen, L., Sun, G.: Squeeze-and-excitation networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7132–7141 (2018)
Lee, M.H., et al.: EEG dataset and OpenBMI toolbox for three BCI paradigms: An investigation into BCI illiteracy. GigaScience 8(5), giz002 (2019)
Tangermann, M., et al.: Review of the BCI competition IV. Front. Neurosci. p. 55 (2012)
Autthasan, P., et al.: Min2net: end-to-end multi-task learning for subject-independent motor imagery EEG classification. IEEE Trans. Biomed. Eng. 69(6), 2105–2118 (2021)
Zhang, K., Robinson, N., Lee, S.W., Guan, C.: Adaptive transfer learning for EEG motor imagery classification with deep convolutional neural network. Neural Netw. 136, 1–10 (2021)
Schirrmeister, R.T., et al.: Deep learning with convolutional neural networks for EEG decoding and visualization. Hum. Brain Mapp. 38(11), 5391–5420 (2017)
Acknowledgment
This research was supported by the Fujian Provincial Natural Science Foundation (Grant No. 2023J01921), the Fujian Provincial Young and Middle-aged Teachers' Education Research Project (Grant No. JAT210265), the Young Tech Innovation Leading Talent Program of Ningbo City (Grant No. 2023QL008), and the Innovation Consortium Program for Green and Efficient Intelligent Appliances of Ningbo City (Grant No. 2022H002).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Jiao, J. et al. (2024). A Domain Adaptation Deep Learning Network for EEG-Based Motor Imagery Classification. In: Huang, DS., Premaratne, P., Yuan, C. (eds) Applied Intelligence. ICAI 2023. Communications in Computer and Information Science, vol 2014. Springer, Singapore. https://doi.org/10.1007/978-981-97-0903-8_11
Download citation
DOI: https://doi.org/10.1007/978-981-97-0903-8_11
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-97-0902-1
Online ISBN: 978-981-97-0903-8
eBook Packages: Computer ScienceComputer Science (R0)