Skip to main content

Human Activity Segmentation Challenge @ ECML/PKDD’23

  • Conference paper
  • First Online:
Advanced Analytics and Learning on Temporal Data (AALTD 2023)

Abstract

Time series segmentation (TSS) is a research problem that focuses on dividing long multivariate sensor data into smaller, homogeneous subsequences. This task is critical for various real-world data analysis applications, such as energy consumption monitoring, climate change assessment, and human activity recognition (HAR). Despite its importance, existing methods demonstrate limited efficacy on real-world multivariate time series data. To advance the field, we organized the Human Activity Segmentation Challenge at ECML/PKDD and AALTD 2023, featuring 57 participants. Collaborating with 15 bachelor computer science students, we gathered and annotated 10.7 h of real-world human motion sensor data. The challenge required participants to segment the resulting 250 multivariate time series into an unknown number of variable-sized activities. The top-8 approaches outperformed existing baselines, but show only limited improvements, capped at 1.9% points. The segmentation of real-world mobile sensing recordings remains challenging. We release the labelled challenge data for future research.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 74.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://ecml-aaltd.github.io/aaltd2023.

  2. 2.

    https://www.kaggle.com/competitions/human-activity-segmentation-challenge.

  3. 3.

    https://www.kaggle.com/competitions/airbus-ship-detection/overview/evaluation.

References

  1. Lara, O.D., Labrador, M.A.: A survey on human activity recognition using wearable sensors. IEEE Commun. Surv. Tutor. 15, 1192–1209 (2013)

    Article  Google Scholar 

  2. Zhou, L., Fischer, E., Brahms, C.M., Granacher, U., Arnrich, B.: Duo-gait: a gait dataset for walking under dual-task and fatigue conditions with inertial measurement units. Sci. Data 10 (2023)

    Google Scholar 

  3. Gupta, N., Gupta, S.K., Pathak, R.K., Jain, V., Rashidi, P., Suri, J.S.: Human activity recognition in artificial intelligence framework: a narrative review. Artif. Intell. Rev. 55, 4755–4808 (2022)

    Article  Google Scholar 

  4. Mukherjee, A., Misra, S., Mangrulkar, P., Rajarajan, M., Rahulamathavan, Y.: Smartarm: a smartphone-based group activity recognition and monitoring scheme for military applications. In: IEEE International Conference on Advanced Networks and Telecommunications Systems (ANTS), pp. 1–6 (2017)

    Google Scholar 

  5. Ermshaus, A., Singh, S., Leser, U.: Time series segmentation applied to a new data set for mobile sensing of human activities. In: EDBT/ICDT Workshops (2023)

    Google Scholar 

  6. Yin, J., Yang, Q., Pan, J.J.: Sensor-based abnormal human-activity detection. IEEE Trans. Knowl. Data Eng. 20, 1082–1090 (2008)

    Article  Google Scholar 

  7. Ahad, M.A.R., Antar, A.D., Ahmed, M.: IoT sensor-based activity recognition - human activity recognition. In: Intelligent Systems Reference Library (2021)

    Google Scholar 

  8. Baños, O., Gálvez, J.M., Damas, M., Pomares, H., Rojas, I.: Window size impact in human activity recognition. Sensors 14, 6474–6499 (2014)

    Article  Google Scholar 

  9. Aminikhanghahi, S., Cook, D.J.: A survey of methods for time series change point detection. Knowl. Inf. Syst. 51, 339–367 (2017)

    Article  Google Scholar 

  10. Truong, C., Oudre, L., Vayatis, N.: Selective review of offline change point detection methods. Sig. Process. 167, 107299 (2020)

    Article  Google Scholar 

  11. Middlehurst, M., Schäfer, P., Bagnall, A.: Bake off redux: a review and experimental evaluation of recent time series classification algorithms. arXiv preprint arXiv:2304.13029 (2023)

  12. Schmidl, S., Wenig, P., Papenbrock, T.: Anomaly detection in time series: a comprehensive evaluation. Proc. VLDB Endow. 15, 1779–1797 (2022)

    Article  Google Scholar 

  13. Schäfer, P., Leser, U.: Motiflets - simple and accurate detection of motifs in time series. Proc. VLDB Endow. 16, 725–737 (2022)

    Article  Google Scholar 

  14. Gharghabi, S., et al.: Domain agnostic online semantic segmentation for multi-dimensional time series. Data Min. Knowl. Disc. 33, 96–130 (2018)

    Google Scholar 

  15. Ermshaus, A., Schäfer, P., Leser, U.: Clasp: parameter-free time series segmentation. Data Min. Knowl. Disc. 37, 1262–1300 (2023)

    Article  MathSciNet  Google Scholar 

  16. Reiss, A., Stricker, D.: Introducing a new benchmarked dataset for activity monitoring. In: 2012 16th International Symposium on Wearable Computers, pp. 108–109 (2012)

    Google Scholar 

  17. Chavarriaga, R., et al.: The opportunity challenge: a benchmark database for on-body sensor-based activity recognition. Pattern Recognit. Lett. 34, 2033–2042 (2013)

    Article  Google Scholar 

  18. Challenge Supporting Materials (2023). https://github.com/patrickzib/human_activity_segmentation_challenge

  19. Bieber, G., Voskamp, J., Urban, B.: Activity recognition for everyday life on mobile phones. In: Universal Access in Human-Computer Interaction (2009)

    Google Scholar 

  20. Elkader, S.A., Barlow, M., Lakshika, E.: Wearable sensors for recognizing individuals undertaking daily activities. In: Proceedings of the 2018 ACM International Symposium on Wearable Computers (2018)

    Google Scholar 

  21. Baños, O., et al.: Design, implementation and validation of a novel open framework for agile development of mobile health applications. Biomed. Eng. Online 14, S6–S6 (2015)

    Google Scholar 

  22. Hallac, D., Nystrup, P., Boyd, S.P.: Greedy gaussian segmentation of multivariate time series. In: Advances in Data Analysis and Classification, pp. 727–751 (2019)

    Google Scholar 

  23. Sadri, A., Ren, Y., Salim, F.D.: Information gain-based metric for recognizing transitions in human activities. Pervas. Mob. Comput. 38, 92–109 (2017)

    Article  Google Scholar 

  24. Talagala, P.D., Hyndman, R.J., Smith-Miles, K.: Anomaly detection in high-dimensional data. J. Comput. Graph. Stat. 30, 360–374 (2019)

    Article  MathSciNet  Google Scholar 

  25. Harańczyk, G.: Change points detection in multivariate signal applied to human activity segmentation. In: AALTD@ECML/PKDD (2023)

    Google Scholar 

  26. Huang, T.-J., Zhou, Q.-L., Ye, H.-J., Zhan, D.-C.: Change point detection via synthetic signals. In: AALTD@ECML/PKDD (2023)

    Google Scholar 

Download references

Acknowledgements

We would like to thank Jonas Albrecht, Alexandria Arnold, Leo Baur, Malte Borgmann, Simon Bosse, Sinan Genc, Alina Hartwich, Isabel Heise, Jan Evert Hinrichs, Hoai Ngoc Ho, Malte Hückelkempkes, Wei Jin, Elida Sengül, Gerrit Slomma and Katharina Winde for their work in creating, recording and annotating the motion sequences for the challenge data.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Arik Ermshaus .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ermshaus, A. et al. (2023). Human Activity Segmentation Challenge @ ECML/PKDD’23. In: Ifrim, G., et al. Advanced Analytics and Learning on Temporal Data. AALTD 2023. Lecture Notes in Computer Science(), vol 14343. Springer, Cham. https://doi.org/10.1007/978-3-031-49896-1_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-49896-1_1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-49895-4

  • Online ISBN: 978-3-031-49896-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics