Francesca Gasparini
ABSTRACT
Physiological data are nowadays frequently used to recognize the affective state of subjects while performing different tasks. Automatic recognition of a stressful state as a consequence of a high level of cognitive load is significant to prevent illnesses like depression, anxiety and sleep disorders that are often due to excessive workload. The spread of wearable sensors that are increasingly reliable and comfortable makes them easy to use in day-life activities. However, due to the nature of experiments that involve subjects, the cardinality of the acquired data is often low, making difficult to train deep learning methods from the scratch. In this paper we consider the photopletismography (PPG) that measures the blood volume registered just under the skin, which can be used to obtain the heart rate of the subject. It is well known that PPG data are particularly relevant to detect high level of arousal that is activated by stress. We show that, converting monodimensional photopletismography (PPG) data into bidimensional signals it is possible to apply a pretrained CNN, obtaining deep features that outperform handcrafted ones in classification tasks, especially introducing feature selections strategies to avoid curse of dimensionality.
- J-P Antoine, Pierre Carrette, Romain Murenzi, and Bernard Piette. 1993. Image analysis with two-dimensional continuous wavelet transform. Signal processing 31, 3 (1993), 241–272.Google Scholar
- Daniel Berrar. 2019. Cross-validation. Encyclopedia of bioinformatics and computational biology 1 (2019), 542–545.Google Scholar
- Anita Biswas, Monalisa Singha Roy, and Rajarshi Gupta. 2019. Motion artifact reduction from finger photoplethysmogram using discrete wavelet transform. In Recent Trends in Signal and Image Processing. Springer, 89–98.Google Scholar
- Patricia J Bota, Chen Wang, Ana LN Fred, and Hugo Plácido Da Silva. 2019. A review, current challenges, and future possibilities on emotion recognition using machine learning and physiological signals. IEEE Access 7(2019), 140990–141020.Google ScholarCross Ref
- Adrian Burns, Emer P Doheny, Barry R Greene, Timothy Foran, Daniel Leahy, Karol O’Donovan, and Michael J McGrath. 2010. SHIMMER™: an extensible platform for physiological signal capture. In 2010 annual international conference of the IEEE engineering in medicine and biology. IEEE, 3759–3762.Google Scholar
- Yekta Said Can, Bert Arnrich, and Cem Ersoy. 2019. Stress detection in daily life scenarios using smart phones and wearable sensors: A survey. Journal of biomedical informatics 92 (2019), 103139.Google ScholarDigital Library
- Silvia Corchs, Elisabetta Fersini, and Francesca Gasparini. 2019. Ensemble learning on visual and textual data for social image emotion classification. International Journal of Machine Learning and Cybernetics 10, 8(2019), 2057–2070.Google ScholarCross Ref
- Mengxi Dai, Dezhi Zheng, Rui Na, Shuai Wang, and Shuailei Zhang. 2019. EEG classification of motor imagery using a novel deep learning framework. Sensors 19, 3 (2019), 551.Google ScholarCross Ref
- David L Donoho and Jain M Johnstone. 1994. Ideal spatial adaptation by wavelet shrinkage. biometrika 81, 3 (1994), 425–455.Google Scholar
- P. Du, E. Li, J. Xia, A. Samat, and X. Bai. 2019. Feature and Model Level Fusion of Pretrained CNN for Remote Sensing Scene Classification. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 12, 8 (2019), 2600–2611. https://doi.org/10.1109/JSTARS.2018.2878037Google ScholarCross Ref
- Rakkrit Duangsoithong and Terry Windeatt. 2010. Correlation-based and causal feature selection analysis for ensemble classifiers. In IAPR Workshop on Artificial Neural Networks in Pattern Recognition. Springer, 25–36.Google ScholarDigital Library
- Daniel Joseph France, Richard G Shiavi, Stephen Silverman, Marilyn Silverman, and M Wilkes. 2000. Acoustical properties of speech as indicators of depression and suicidal risk. IEEE transactions on Biomedical Engineering 47, 7 (2000), 829–837.Google ScholarCross Ref
- Louis Guttman. 1974. The basis for scalogram analysis. Bobbs-Merrill, College Division.Google Scholar
- Matthias Holschneider, Richard Kronland-Martinet, Jean Morlet, and Ph Tchamitchian. 1990. A real-time algorithm for signal analysis with the help of the wavelet transform. In Wavelets. Springer, 286–297.Google Scholar
- Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. Advances in neural information processing systems 25 (2012), 1097–1105.Google Scholar
- Chul Min Lee and Shrikanth S Narayanan. 2005. Toward detecting emotions in spoken dialogs. IEEE transactions on speech and audio processing 13, 2(2005), 293–303.Google Scholar
- Wei Li. 2018. Wavelets for electrocardiogram: overview and taxonomy. IEEE Access 7(2018), 25627–25649.Google ScholarCross Ref
- Yongbo Liang, Zhencheng Chen, Rabab Ward, and Mohamed Elgendi. 2018. Photoplethysmography and deep learning: enhancing hypertension risk stratification. Biosensors 8, 4 (2018), 101.Google ScholarCross Ref
- J. M. Lilly and S. C. Olhede. 2012. Generalized Morse Wavelets as a Superfamily of Analytic Wavelets. IEEE Transactions on Signal Processing 60, 11 (2012), 6036–6041. https://doi.org/10.1109/TSP.2012.2210890Google ScholarDigital Library
- Cherie Madarash-Hill and JB Hill. 2004. Enhancing access to IEEE Conference Proceedings: a case study in the application of IEEE Xplore full text and table of contents enhancements. Science & Technology Libraries 24, 3-4 (2004), 389–399.Google ScholarCross Ref
- Guy P Nason and Bernard W Silverman. 1995. The stationary wavelet transform and some statistical applications. In Wavelets and statistics. Springer, 281–299.Google Scholar
- Aaqib Saeed, Stojan Trajanovski, Maurice Van Keulen, and Jan Van Erp. 2017. Deep physiological arousal detection in a driving simulator using wearable sensors. In 2017 IEEE International Conference on Data Mining Workshops (ICDMW). IEEE, 486–493.Google ScholarCross Ref
- Ali Sharif Razavian, Hossein Azizpour, Josephine Sullivan, and Stefan Carlsson. 2014. CNN features off-the-shelf: an astounding baseline for recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition workshops. 806–813.Google Scholar
- Siddharth Siddharth, Tzyy-Ping Jung, and Terrence J Sejnowski. 2019. Utilizing deep learning towards multi-modal bio-sensing and vision-based affective computing. IEEE Transactions on Affective Computing(2019).Google ScholarCross Ref
- Phyllis K Stein, Matthew S Bosner, Robert E Kleiger, and Brooke M Conger. 1994. Heart rate variability: a measure of cardiac autonomic tone. American heart journal 127, 5 (1994), 1376–1381.Google Scholar
- Manida Swangnetr and David B Kaber. 2012. Emotional state classification in patient–robot interaction using wavelet analysis and statistics-based feature selection. IEEE Transactions on Human-Machine Systems 43, 1 (2012), 63–75.Google ScholarCross Ref
- Terumi Umematsu, Akane Sano, Sara Taylor, and Rosalind W Picard. 2019. Improving students’ daily life stress forecasting using lstm neural networks. In 2019 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI). IEEE, 1–4.Google ScholarCross Ref
- Ryan J Urbanowicz, Melissa Meeker, William La Cava, Randal S Olson, and Jason H Moore. 2018. Relief-based feature selection: Introduction and review. Journal of biomedical informatics 85 (2018), 189–203.Google ScholarDigital Library
Recommendations
Critical element prediction of tracheal intubation difficulty: Automatic Mallampati classification by jointly using handcrafted and attention-based deep features
AbstractPreoperative assessment of the difficulty of tracheal intubation is of great importance in anesthesia practice because failed intubation can lead to severe complications and even death. The Mallampati score is widely used as a critical assessment ...
Graphical abstractOur method extracts deep features that are more favorable for the Mallampati classification task by introducing the coordinate attention (CA) module into the basic deep convolutional neural network, and then further improves Mallampati ...
Highlights- Introducing an attention mechanism to DCNN to extract attention-based deep features.
- Training DCNN using a transfer learning approach when extracting deep features.
- Extracting two handcrafted features, namely HOG and LBP.
- Joint ...
Recognizing Gastrointestinal Malignancies on WCE and CCE Images by an Ensemble of Deep and Handcrafted Features with Entropy and PCA Based Features Optimization
AbstractIn medical imaging, automated detection of stomach and gastrointestinal diseases using WCE (wireless capsule endoscopy) images is an emerging research domain. It includes numerous limitations and challenges such as variation in the contrast, ...
A Deep Learning Approach to Estimate SpO2 from PPG Signals
ICBRA '22: Proceedings of the 9th International Conference on Bioinformatics Research and ApplicationsBlood oxygen saturation level (SpO2) is one of the vital parameters determining the hemostability of a patient, besides heart rate (HR), respiratory rate (RR) and blood preasure (BP). In emergency situations with a high number of injured persons, during ...
Comments