Paul Morat
ABSTRACT
Nachtalb is an immersive interface that enables brain-to-brain interaction using multisensory feedback. With the help of the g.tec Unicorn Hybrid Black brain-computer-interface (BCI), brain-activity-data is measured and translated visually with the Oculus Quest 2, tactilely with the bHaptics TactSuit and auditorily with 3D Sound. This intends to create a feedback loop that turns brain activity from data-input into sensory output which directly influences the brain activity data-input again.
- Emanuele Argento, George Papagiannakis, Eva Baka, Michail Maniadakis, Panos Trahanias, Michael Sfakianakis, and Ioannis Nestoros. 2017. Augmented Cognition via Brainwave Entrainment in Virtual Reality: An Open, Integrated Brain Augmentation in a Neuroscience System Approach. Augmented Human Research 2 (2017), 1–14.Google Scholar
Cross Ref
- Christian Breitwieser, Vera Kaiser, Christa Neuper, and Gernot R Müller-Putz. 2012. Stability and distribution of steady-state somatosensory evoked potentials elicited by vibro-tactile stimulation. Medical and Biological Engineering and Computing 50, 4 (2012), 347–357.Google ScholarCross Ref
- Zitong Chen, Jing Liao, Jianqiao Chen, Chuyi Zhou, Fangbing Chai, Yang Wu, and Preben Hansen. 2021. Paint with Your Mind: Designing EEG-Based Interactive Installation for Traditional Chinese Artworks. In Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction. Association for Computing Machinery, New York, NY, USA.Google ScholarDigital Library
- Judith Amores Fernandez, Anna Fusté, Robert Richer, and Pattie Maes. 2019. Deep Reality: An Underwater VR Experience to Promote Relaxation by Unconscious HR, EDA, and Brain Activity Biofeedback. In ACM SIGGRAPH 2019 Virtual, Augmented, and Mixed Reality (Los Angeles, California) (SIGGRAPH ’19). Association for Computing Machinery, New York, NY, USA.Google ScholarDigital Library
- Yisi Liu, Olga Sourina, and Minh Khoa Nguyen. 2010. Real-Time EEG-Based Human Emotion Recognition and Visualization. In 2010 International Conference on Cyberworlds. IEEE Press, Piscataway, NJ, 262–269.Google Scholar
- Paul L. Nunez and Ramesh Srinivasan. 2006. Electric Fields of the Brain: The neurophysics of EEG. Oxford University Press, Oxford, UK.Google Scholar
- Marc Parenthoen, Fred Murie, and Flavien Thery. 2015. The Sea is Your Mirror. In Proceedings of the 8th ACM SIGGRAPH Conference on Motion in Games (Paris, France) (MIG ’15). Association for Computing Machinery, New York, NY, USA, 159–165.Google ScholarDigital Library
- Roland Sigrist, Georg Rauter, Robert Riener, and Peter Wolf. 2013. Augmented visual, auditory, haptic, and multimodal feedback in motor learning: a review. Psychonomic Bulletin and Review 20, 1 (2013), 21–53.Google ScholarCross Ref
- Ranganatha Sitaram and Tomas Ros. 2017. Closed-loop brain training: the science of neurofeedback. Nature reviews. Neuroscience 18, 2 (2017), 86–100.Google Scholar
- Tom De Smedt and Lieven Menschaert. 2012. VALENCE: affective visualisation using EEG. Digital Creativity 23, 3-4 (2012), 272–277.Google ScholarCross Ref
- Nina Sobell. 2002. Streaming the Brain. IEEE MultiMedia 9, 3 (2002), 4–9.Google Scholar
- Eleftherios Triantafyllidis, Christopher Mcgreavy, Jiacheng Gu, and Zhibin Li. 2020. Study of Multimodal Interfaces and the Improvements on Teleoperation. IEEE Access 8(2020), 78213–78227.Google ScholarCross Ref
- Bram van de Laar, Hayrettin Gürkök, Danny Plass-Oude Bos, Mannes Poel, and Anton Nijholt. 2013. Experiencing BCI Control in a Popular Computer Game. IEEE Transactions on Computational Intelligence and AI in Games 5, 2(2013), 176–184.Google ScholarCross Ref
Recommendations
Nachtalb: A multisensory Neurofeedback VR-Interface
SA '21 XR: SIGGRAPH Asia 2021 XRNachtalb is an immersive interface that enables brain-to-brain interaction using multisensory feedback. With the help of the g.tec Unicorn Hybrid Black brain-computer-interface (BCI), brain-activity-data is measured and translated visually with the ...
Multisensory integration during short-term music reading training enhances both uni-and multisensory cortical processing
The human ability to integrate the input of several sensory systems is essential for building a meaningful interpretation out of the complexity of the environment. Training studies have shown that the involvement of multiple senses during training ...
Selective Attention and Multisensory Integration: Multiple Phases of Effects on the Evoked Brain Activity
We used event-related potentials (ERPs) to evaluate the role of attention in the integration of visual and auditory features of multisensory objects. This was done by contrasting the ERPs to multisensory stimuli (AV) to the sum of the ERPs to the ...
Comments