Skip to main content

Spatiotemporal Clustering of Human Locomotion Neuropsychological Assessment in Virtual Reality Using Multi-step Model

  • Conference paper
  • First Online:
Digital Technologies and Applications (ICDTA 2023)

Abstract

In this study, We implemented a spatiotemporal clustering approach to analyze the outcome of a virtual reality human navigation neuropsychological assessment(the VR Magic Carpet). Our main objective was to establish a clustering of participants using a deep multi-step clustering model on velocity signals extracted during clinical trials. We used a multi-step neural network architecture to analyze the feature extraction and the clustering stage separately. In the feature extraction stage, we adopted a 1D-DCAE autoencoder, and for the clustering, we used a soft temporal clustering layer, a combination of similarity metrics, K-means, and probability. This method enabled us to comprehend, to a certain extent, the clustering results in contrast to the joint architecture we have been using before. We obtained five significant clusters that are associated with specific clinical groups.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 229.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 299.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Krzy´sko, M., et al.: A spatio-temporal analysis of the health situation inpoland based on functional discriminant coordinates. Int. J. Environ. Res. Public Health 18(3), 1109 (2021). https://doi.org/10.3390/ijerph18031109

  2. Byun, H.G., Lee, N., Hwang, S.S.: A systematic review of spatial and spatio-temporal analyses in public health research in Korea. J. Prev. Med. Public Health 54(5), 301–308 (2021). https://doi.org/10.3961/jpmph.21.160.PMID:34649392;PMCID:PMC8517372

    Article  Google Scholar 

  3. Nurjannah, N., Baker, K.M., Mashinini, D.P.: Spatiotemporal trends in diabetes-related mortality by school district in the state of Michigan. United States. Epidemiology Health 43(e2021098), 2021 (2021). https://doi.org/10.4178/epih.e2021098.Publishedonline:November9

    Article  Google Scholar 

  4. Gao, Y., et al.: Spatial and Temporal Characteristics of Hand-Foot-and-Mouth Disease and Their Influencing Factors in Urumqi, China. International Journal of Environmental Research and Public Health, 18 (2021)

    Google Scholar 

  5. Feng, Q., Huang, Y., Long, Y., Gao, L., Gao, X.: A deep spatiotemporal attention network for mild cognitive impairment identification. Front. Aging Neurosci. 14 (2022). doi.https://doi.org/10.3389/fnagi.2022.925468

  6. Turhan, G., Küçük, H., Ozturk Isik, E.: Spatio-temporal convolution for classification of Alzheimer’s disease and mild cognitive impairment. Comput. Biology Med. 221, 106825 (2022). DOI: https://doi.org/10.1016/j.cmpb.2022.106825. PMID: 35636355

  7. Crook-Rumsey, M., et al.: Spatiotemporal EEG Dynamics of Prospective Memory in Ageing and Mild Cognitive Impairment. Cognitive Computation, 14 Open Access Published: November 23, 2022 (2022)

    Google Scholar 

  8. Ciecierski-Holmes, T., et al.: Artificial intelligence for strengthening healthcare systems in low- and middle-income countries: a systematic scoping review. npj Digital Med. 5, 1, (2022). https://doi.org/10.1038/s41746-022-00700-y

  9. Liao, M., et al.: Cluster analysis and its application to healthcare claims data: a study of end-stage renal disease patients who initiated hemodialysis. BMC Nephrol. 17, 1 (2016). https://doi.org/10.1186/s12882-016-0238-2

    Article  Google Scholar 

  10. Annaki, I., et al.: Computational analysis of human navigation trajectories in a spatial memory locomotor task. In: Motahhir, S., Bossoufi, B. (eds.) ICDTA 2021. LNNS, vol. 211, pp. 233–243. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-73882-2_22

    Chapter  Google Scholar 

  11. I. Annaki, M., et al.: Clustering analysis of human navigation trajectories in a visuospatial memory locomotor task using K-means and hierarchical agglomerative clustering. In: E3S Web of Conferences, vol. 351, p. 01042 (2022). https://doi.org/10.1051/e3sconf/202235101042

  12. Annaki, I., et al.: Computational Analysis of Human Navigation in a VR Spatial Memory Locomotor Assessment Using Density-Based Clustering Algorithm of Applications with Noise DBSCAN Digital Technologies and Applications, pp.190–198 (2022). https://doi.org/10.1007/978-3-031-02447-4_20

  13. Richard, G., Grossin, B., Germaine, G., Hebrail, G., de Moliner, A.: Autoencoder-based time series clustering with energy applications. arXiv 2020, arXiv:2002.03624

  14. Zhang, G., Singer, A.R., Vlahopoulos, N.: Temporal clustering network for self-diagnosing faults from vibration measurements. arXiv 2020, arXiv:2006.09505

  15. Berthoz, A., Zaoui, M.: New paradigms and tests for evaluating and remediating visuospatial deficits in children. Dev. Med. Child Neurol. 57(Suppl 2), 15–20 (2015). https://doi.org/10.1111/dmcn.12690

    Article  Google Scholar 

  16. Corsi, P.M.: Human memory and the medial temporal region of the brain (Ph.D.). McGill University (1972)

    Google Scholar 

  17. Berch, D.B., Krikorian, R., Huha, E.M.: The Corsi block-tapping task: methodological and theoretical considerations. Brain Cogn. 38(3), 317–338 (1998). https://doi.org/10.1006/brcg.1998.1039

    Article  Google Scholar 

  18. Murtagh, E.M., Mair, J.L., Aguiar, E., Tudor-Locke, C., Murphy, M.H.: Outdoor walking speeds of apparently healthy adults: a systematic review and meta-analysis. Sports Med. 51(1), 125–141 (2020). https://doi.org/10.1007/s40279-020-01351-3

    Article  Google Scholar 

  19. Alqahtani, A., et al.: Deep time-series clustering: a review. Electronics 10, 23,3001 (2021). https://doi.org/10.3390/electronics10233001

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ihababdelbasset Annaki .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Annaki, I. et al. (2023). Spatiotemporal Clustering of Human Locomotion Neuropsychological Assessment in Virtual Reality Using Multi-step Model. In: Motahhir, S., Bossoufi, B. (eds) Digital Technologies and Applications. ICDTA 2023. Lecture Notes in Networks and Systems, vol 669. Springer, Cham. https://doi.org/10.1007/978-3-031-29860-8_98

Download citation

Publish with us

Policies and ethics