Abstract
Physicians require an adequate display system with a console within arm’s reach to view images during surgical operations and interventional radiological examinations. However, manipulation of the console by physicians themselves may not be possible because their hands may be otherwise engaged. In this study, an image manipulation system using an electroencephalogram (EEG) sensor mounted on the operator’s head was developed. In this system, data acquired by the device is used to manipulate images, and the output can be converted to commands for various actions such as paging, which can be controlled by the operator’s eye-blink, and zooming of a region indicated by the cursor, which can be controlled by the operator’s mental concentration. In this study, the MindWave Mobile headset was used as EEG sensor, and AZEWIN for the display system. Ten observers were enrolled and fitted with EEG device to determine the threshold values of blink strength and attention; threshold value of 100 for blink strength and 65 for attention were determined. Thirty-one observers were enrolled and fitted with EEG device to investigate average response-time; the average response time for detecting paging was 0.43 ± 0.02 s, and that for zooming was 5.85 ± 0.56 s. Thus, the proposed image manipulation system using the operator’s EEG signals enabled physicians to assess and manipulate images without using their hands.
References
Ogura T, Sato M, Ishida Y, Hayashi N, Doi K. Development of a novel method for manipulation of angiographic images by use of a motion sensor in operating rooms. Radiol Phys Technol. 2014;7(2):228–34.
Sato M, Ogura T, Yasumoto. Y, Kadowaki Y, Hayashi N, Doi K. Development of an image operation system with a motion sensor in dental radiology. Radiol Phys Technol. 2015;8(2):243–7.
EEG Biosensors. http://neurosky.com/biosensors/eeg-sensor/ Accessed 25 Feb 2018.
Sałabun W. Processing and spectral analysis of the raw EEG signal from the MindWave. Przegląd Elektrotechniczny. 2014;90(2):169–73.
Klimesch W. EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis. Brain Res Rev. 1999;29:169–95.
Steriade M. Thalamocortical oscillations in the sleeping and aroused brain. Science. 1993;262(5134):679–85.
Sederberg PB. Theta and gamma oscillations during encoding predict subsequent recall. J Neurosci. 2003;23(34):10809–14.
Adrian ED, Matthews BHC. The berger rhythm: potential changes from the occipital lobes in man. Brain. 1934;57(4):355–85.
Yoshida K. Evaluation of the change of work using simple electroencephalography. Proc Comput Sci. 2013;22:855–62.
Akhil PS. Brain computer interface for wheelchair movement using blink detection. Int Res J Eng Technol. 2018;5(4):4980–3.
Navalyal GU. A dynamic attention assessment and enhancement tool using computer graphics. Hum Centric Comput Inf Sci. 2014;4(11):1–7.
Sezer A. An Investigation of University Students’ attention levels in real classroom settings with NeuroSky’s MindWave Mobile (EEG) Device. In: International educational technology conference, pp. 88–101; 2015.
Liu NH. Recognizing the degree of human attention using EEG signals from mobile sensors. Sensors. 2013;13:10273–86.
Yamauchi T. Dynamic time warping: a single dry electrode EEG study in a self-paced learning task. In: International conference on affective computing and intelligent interaction, pp. 56–62; 2015.
Lim CG. A brain–computer interface based attention training program for treating attention deficit hyperactivity disorder. PLoS One. 2012;7(10):1–8.
Twigg P. Exploration of the effect of electroencephalograph levels in experienced archers. Meas Control. 2014;47(6):185–90.
Maria CC, Julieta R, et al. Gender differences in the EEG During cognitive activity. Int J Neurosci. 1993;72:257–64.
Zhang X, Liu X, Yuan S-M, Lin S-F. Eye tracking based control system for natural human–computer interaction. Comput Intell Neurosci. 2017. https://doi.org/10.1155/2017/5739301.
Jacob RJK. The use of eye movements in human–computer interaction techniques: what you look at is what you get. ACM Trans Inf Syst. 1991;9(3):152–69.
Acknowledgements
The authors wish to thank the students at Gunma Prefectural College of Health Sciences who were participant observers for their assistance in the measurements, members of the Department of Radiology and Clinical Laboratory at Japan Red Cross Society Maebashi Hospital for their helpful assistance, and Mr. Toshio Kubota and Mr. Hiromitsu Hoshino, PhD for their useful advice.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest related to this study.
Ethical statement
This work has not been published before in part or entirety. All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed consent
Informed consent was obtained from all individual participants included in the study.
Animal rights
This study did not include an animal model.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Sato, M., Ogura, T., Yamanouchi, S. et al. Development of a new image manipulation system based on detection of electroencephalogram signals from the operator’s brain: a feasibility study. Radiol Phys Technol 12, 172–177 (2019). https://doi.org/10.1007/s12194-019-00508-8
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12194-019-00508-8