Skip to main content
SpringerLink
Log in

Designing and evaluating safety services using depth cameras

  • Original Research
  • Published:
Journal of Ambient Intelligence and Humanized Computing Aims and scope Submit manuscript

Abstract

Not receiving help in the case of an emergency is one of the most common fears of older adults that live independently at home. Falls are a particularly frequent occurrence and often the cause of serious injuries. In the last years, various ICT solutions for supporting older adults at home have been developed. Based on sensors and services in a smart environment they provide a wide range of services. In this work we have designed and evaluated safety-related services, based on a single Microsoft Kinect that is installed in a user’s home. We created two services to investigate the benefits and limitations of these solutions. The first is a fall detection service that registers falls in real-time, using a novel combination of static and dynamic skeleton tracking. The second is a fall prevention service that detects potentially dangerous objects in the walking path, based on scene analysis in a depth image. We conducted technical and user evaluations for both services, in order to get feedback on the feasibility, limitations, and potential future improvements.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Notes

  1. http://cordis.europa.eu/project/rcn/110902_en.html (Accessed 27-07-2017).

References

  • Alwan M, Rajendran PJ, Kell S, Mack D, Dalal S, Wolfe M, Felder R (2006) A smart and passive floor-vibration based fall detector for elderly. In: Information and communication technologies, ICTTA'06, 2nd, vol 1. IEEE, pp 1003–1007

  • Braun A, Heggen H, Wichert R (2012) Capfloor—a flexible capacitive indoor localization system. In: Chessa S, Knauth S (eds) Evaluating AAL systems through competitive benchmarking. Indoor localization and tracking: international competition, EvAAL 2011, competition in valencia, Spain, July 25–29, 2011, and Final Workshop in Lecce, Italy, September 26, 2011. Springer, Berlin, pp 26–35 (Revised Selected Papers)

    Chapter  Google Scholar 

  • Braun A, Wichert R, Kuijper A, Fellner DW (2015) Capacitive proximity sensing in smart environments. J Ambient Intell Smart Environ 7(4):483–510

    Article  Google Scholar 

  • Campbell AJ, Reinken J, Allan BC, Martinez GS (1981) Falls in old age: a study of frequency and related clinical factors. Age Ageing 10(4):264–270

    Article  Google Scholar 

  • Chen L, Wei H, Ferryman J (2013) A survey of human motion analysis using depth imagery. Pattern Recognit Lett 34(15):1995–2006 (Smart Approaches for Human Action Recognition)

    Article  Google Scholar 

  • Chen J, Kwong K, Chang D, Luk J, Bajcsy R (2006) Wearable sensors for reliable fall detection. In: 27th Annual international conference of the Engineering in Medicine and Biology Society. IEEE-EMBS 2005. IEEE, pp 3551–3554

  • Delahoz YS, Labrador MA (2014) Survey on fall detection and fall prevention using wearable and external sensors. Sensors 14(10):19806–19842

    Article  Google Scholar 

  • Demiris G, Rantz MJ, Aud MA, Marek KD, Tyrer HW, Skubic M, Hussam AA (2004) Older adults’ attitudes towards and perceptions of ‘smart home’technologies: a pilot study. Med Inform Internet Med 29(2):87–94

    Article  Google Scholar 

  • Depth Sensor Shootout (2017). http://stimulant.com/depth-sensor-shootout-2/. Accessed 23 May 2018

  • Di P, Huang J, Sekiyama K, Fukuda T (2011) A novel fall prevention scheme for intelligent cane robot by using a motor driven universal joint. In: 2011 International symposium on micro-nanomechatronics and human science (MHS). IEEE, pp 391–396

  • Dissanayake MWMG, Newman P, Clark S, Durrant-Whyte HF, Csorba M (2001) A solution to the simultaneous localization and map building (slam) problem. IEEE Trans Robot Autom 17(3):229–241

    Article  Google Scholar 

  • Fryar CD, Gu Q, Ogden CL (2012) Anthropometric reference data for children and adults: United States, 2007–2010. Vital Health Stat Ser 11 Data Natl Health Surv 252:1–48

    Google Scholar 

  • Gasparrini S, Cippitelli E, Spinsante S, Gambi E (2014) A depth-based fall detection system using a kinect\(\textregistered \) sensor. Sensors 14(2):2756

    Article  Google Scholar 

  • Georgiadis D, Andreou P, Konstantinidis A, Christophorou C, Sandner E, Hanke S, Tsiourti C, Aristogenis Fanourakis M, Mettel MR (2015) Design and specification of ICT-based services and safety services. Tech Rep. Public Deliverable D4.1b Miraculous Life project, pp 42–45

  • Hamm J, Money AG, Atwal A, Paraskevopoulos I (2016) Fall prevention intervention technologies: a conceptual framework and survey of the state of the art. J Biomed Inform 59:319–345

    Article  Google Scholar 

  • Hanke S, Sandner E, Stainer-Hochgatterer A, Tsiourti C, Braun A (2015) The technical specification and architecture of a virtual support partner. In: AmI (Workshops/Posters)

  • Henry P, Krainin M, Herbst E, Ren X, Fox D (2012) RGB-D mapping: using kinect-style depth cameras for dense 3D modeling of indoor environments. Int J Robt Res 31(5):647–663

    Article  Google Scholar 

  • Joly C, Düne C, Gorce P, Rives P (2013) Füße und Beine verfolgen mit einem intelligenten Rollator mit Kinect. In: Zusammenarbeit mit IEEE / RSJ Int. Conf. auf Int. Rob. und Sys. (IROS) Workshop zum Thema “Assistenz und Servicerobotik in einer menschlichen Umgebung”, Tokyo, Japan

  • Kawatsu C, Li J, Chung CJ (2013) Robot intelligence technology and applications 2012: an edition of the presented papers from the 1st international conference on robot intelligence technology and applications. Springer, Berlin, pp 623–630

    Book  Google Scholar 

  • Kepski M, Kwolek B (2013) Human fall detection using Kinect sensor. In: Proceedings of the 8th international conference on computer recognition systems CORES 2013. Springer, Heidelberg, pp 743–752

    Chapter  Google Scholar 

  • Kepski M, Kwolek B (2014) Fall detection using ceiling-mounted 3d depth camera. In: 2014 International conference on computer vision theory and applications (VISAPP), vol 2. IEEE, pp 640–647

  • Kinect for Windows SDK v1.8-Skeletal Tracking (2018). https://msdn.microsoft.com/en-us/library/hh973074.aspx. Accessed 23 May 2018

  • Kinect for Windows SDK-Features (2018). http://msdn.microsoft.com/de-de/library/dn782025.aspx. Accessed 23 May 2018

  • Kinect for Windows SDK-Kinect API Overview (2018). http://msdn.microsoft.com/de-de/library/dn782033.aspx. Accessed 23 May 2018

  • Kirchbuchner F, Grosse-Puppendahl T, Hastall MR, Distler M, Kuijper A (2015) Ambient intelligence from senior citizens’ perspectives: understanding privacy concerns, technology acceptance, and expectations. In: European conference on ambient intelligence. Springer, Cham, pp 48–59

    Chapter  Google Scholar 

  • Lange B, Chang CY, Suma E, Newman B, Rizzo AS, Bolas M (2011) Development and evaluation of low cost game-based balance rehabilitation tool using the Microsoft Kinect sensor. In: 2011 annual international conference of the IEEE Engineering in Medicine and Biology Society, EMBC. IEEE, pp 1831–1834

  • Lu F, Milios E (1997) Globally consistent range scan alignment for environment mapping. Auton Robots 4(4):333–349

    Article  Google Scholar 

  • Majumder AJA, Zerin I, Uddin M, Ahamed SI, Smith RO (2013) SmartPrediction: a real-time smartphone-based fall risk prediction and prevention system. In: Proceedings of the 2013 research in adaptive and convergent systems. ACM, pp 434–439

  • Mettel MR, Alekseew M, Stocklöw C, Braun A (2017) Safety services in smart environments using depth cameras. In: European conference on ambient intelligence. Springer, Cham, pp 80–93

    Chapter  Google Scholar 

  • Prediger M, Braun A, Marinc A, Kuijper A (2014) Robot-supported pointing interaction for intelligent environments. In: Streitz N, Markopoulos P (eds) Proceedings of distributed, ambient, and pervasive interactions: second international conference, DAPI 2014, held as part of HCI international 2014, Heraklion, Crete, Greece. Springer International Publishing, Cham, pp 172–183

    Chapter  Google Scholar 

  • Rajendran P, Corcoran A, Kinosian B, Alwan M (2008) Falls, fall prevention, and fall detection technologies. In: Eldercare technology for clinical practitioners. Humana Press, pp 187–202

  • Rougier C, Meunier J, St-Arnaud A, Rousseau J (2007) Fall detection from human shape and motion history using video surveillance. In: 21st International conference on advanced information networking and applications workshops, AINAW'07, vol 2. IEEE, pp 875–880

  • Rusu RB, Cousins S (2011) 3d is here: Point cloud library (pcl). In: 2011 IEEE international conference on robotics and automation (ICRA). IEEE, pp 1–4

  • Shotton J, Fitzgibbon A, Cook M, Sharp T, Finocchio M, Moore R, Kipman A, Blake A (2013) Real-time human pose recognition in parts from single depth images. Commun ACM 56(1):116–124

    Article  Google Scholar 

  • Su BY, Ho KC, Rantz MJ, Skubic M (2015) Doppler radar fall activity detection using the wavelet transform. IEEE Trans Biomed Eng 62(3):865–875

    Article  Google Scholar 

  • Tsiourti C, Joly E, Wings C, Moussa MB, Wac K (2014) Virtual assistive companions for older adults: qualitative field study and design implications. In: Proceedings of the 8th international conference on pervasive computing technologies for healthcare. ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), pp 57–64

  • Webster D, Celik O (2014) Systematic review of kinect applications in elderly care and stroke rehabilitation. J Neuroeng Rehabilit 11(1):108

    Article  Google Scholar 

Download references

Acknowledgements

We would like to thank all volunteers that participated in our study and provided valuable feedback. This work was partially funded by EC Grant agreement no. 611421.

Author information

Authors and Affiliations

  1. Fraunhofer Institute for Computer Graphics Research IGD, Fraunhoferstr. 5, 64283, Darmstadt, Germany

    Matthias Ruben Mettel, Michael Alekseew, Carsten Stocklöw & Andreas Braun

Authors
  1. Matthias Ruben Mettel
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Michael Alekseew
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Carsten Stocklöw
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Andreas Braun
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Andreas Braun.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mettel, M.R., Alekseew, M., Stocklöw, C. et al. Designing and evaluating safety services using depth cameras. J Ambient Intell Human Comput 10, 747–759 (2019). https://doi.org/10.1007/s12652-018-0898-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12652-018-0898-9

Keywords

Search

Navigation