Skip to main content
Log in

Hybrid domain adaptation for sensor-based human activity recognition in a heterogeneous setup with feature commonalities

  • Theoretical Advances
  • Published:
Pattern Analysis and Applications Aims and scope Submit manuscript

Abstract

Common approaches in the cross-domain sensor-based human activity recognition are based on the homogeneous domain adaptation which relies on the assumption that the training and testing data are of homogeneous feature space. In reality, such an assumption does not always hold. For example, although two devices may share common sensors, it is possible that each of them has its own specific sensors. In this case, the homogeneous domain adaptation approaches cannot be used directly. Although heterogeneous domain adaptation approaches have been proposed to handle such feature space heterogeneity, most of them require some label information in the target domain, which is often difficult to obtain. As a compromise, the hybrid domain adaptation has been recently proposed to address feature space heterogeneity. Instead of using the target domain label information, it exploits the common features between domains as additional information, so the adaptation can be performed in an unsupervised manner. However, it still neglects the possibility of the common features between domains having different distribution, which may lead to the negative transfer of the domain-specific features. In this work, we introduce a domain-invariant latent representation of the common features to enhance the specific feature transfer in the hybrid domain adaptation approach. The latent representation learning and the domain-specific feature transfer are performed jointly using an autoencoder-based framework. The experimental result shows that the performance improves when the common features are furthermore aligned in the latent space. It is also shown that, in overall, our model outperforms existing approaches, yielding up to 9.48% accuracy improvement.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Notes

  1. https://github.com/HIPS/autograd.

References

  1. Li W, Xu Y, Tan B, Piechocki RJ (2017) Passive wireless sensing for unsupervised human activity recognition in healthcare. In: 2017 13th International on wireless communications and mobile computing conference (IWCMC), pp 1528–1533. IEEE

  2. Braunagel C, Kasneci E, Stolzmann W, Rosenstiel W (2015) Driver-activity recognition in the context of conditionally autonomous driving. In: 2015 IEEE 18th international conference on intelligent transportation systems (ITSC), pp 1652–1657. IEEE

  3. Attal F, Mohammed S, Dedabrishvili M, Chamroukhi F, Oukhellou L, Amirat Y (2015) Physical human activity recognition using wearable sensors. Sensors 15(12):31314–31338

    Article  Google Scholar 

  4. Wang J, Chen Y, Hu L, Peng X, Philip SY (2018) Stratified transfer learning for cross-domain activity recognition. In: 2018 IEEE international conference on pervasive computing and communications(PerCom), pp 1–10. IEEE

  5. Shi X, Liu Q, Fan W, Philip SY, Zhu R (2010) Transfer learning on heterogenous feature spaces via spectral transformation. In: 2010 IEEE 10th international conference on data mining (ICDM), pp 1049–1054. IEEE

  6. Kulis B, Saenko K, Darrell T (2011) What you saw is not what you get: domain adaptation using asymmetric kernel transforms. In: 2011 IEEE conference on computer vision and pattern recognition (CVPR), pp 1785–1792. IEEE

  7. Wang C, Mahadevan S (2011) Heterogeneous domain adaptation using manifold alignment. In: IJCAI proceedings-international joint conference on artificial intelligence, vol 22, p 1541

  8. Wei P, Ke Y, Goh CK (2018) A general domain specific feature transfer framework for hybrid domain adaptation. IEEE Trans Knowl Data Eng 31:1440–1451

    Article  Google Scholar 

  9. Lara OD, Labrador MA et al (2013) A survey on human activity recognition using wearable sensors. IEEE Commun Surv Tutor 15(3):1192–1209

    Article  Google Scholar 

  10. Ponce H, Martínez-Villaseñor M, Miralles-Pechuán L (2016) A novel wearable sensor-based human activity recognition approach using artificial hydrocarbon networks. Sensors 16(7):1033

    Article  Google Scholar 

  11. Wannenburg J, Malekian R (2017) Physical activity recognition from smartphone accelerometer data for user context awareness sensing. IEEE Trans Syst Man Cybern Syst 47(12):3142–3149

    Article  Google Scholar 

  12. Jahn A, Kroll D, Lau SL, David K (2017) An activity history based approach for recognizing the mode of transportation. In: 2017 IEEE conference on open systems (ICOS), pp 21–25. IEEE

  13. Aramendi AA, Weakley A, Goenaga AA, Schmitter-Edgecombe M, Cook DJ (2018) Automatic assessment of functional health decline in older adults based on smart home data. J Biomed Inform 81:119–130

    Article  Google Scholar 

  14. Gong B, Shi Y, Sha F, Grauman K (2012) Geodesic flow kernel for unsupervised domain adaptation. In: 2012 IEEE conference on computer vision and pattern recognition (CVPR), pp 2066–2073. IEEE

  15. Fernando B, Habrard A, Sebban M, Tuytelaars T (2013) Unsupervised visual domain adaptation using subspace alignment. In: Proceedings of the IEEE international conference on computer vision, pp 2960–2967

  16. Long M, Wang J, Jiaguang S, Philip SY (2015) Domain invariant transfer kernel learning. IEEE Trans Knowl Data Eng 27(6):1519–1532

    Article  Google Scholar 

  17. Zhang J, Li W, Ogunbona P (2017) Joint geometrical and statistical alignment for visual domain adaptation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1859–1867

  18. Blitzer J, McDonald R, Pereira F (2006) Domain adaptation with structural correspondence learning. In: Proceedings of the 2006 conference on empirical methods in natural language processing, pp 120–128. Association for Computational Linguistics

  19. Glorot X, Bordes A, Bengio Y (2011) Domain adaptation for large-scale sentiment classification: a deep learning approach. In: Proceedings of the 28th international conference on machine learning (ICML-11), pp 513–520

  20. Pan J, Hu X, Li P, Li H, He W, Zhang Y, Lin Y (2016) Domain adaptation via multi-layer transfer learning. Neurocomputing 190:10–24

    Article  Google Scholar 

  21. Wu F, Huang Y (2016) Sentiment domain adaptation with multiple sources. In: Proceedings of the 54th annual meeting of the association for computational linguistics (Volume 1: Long Papers), vol 1, pp 301–310

  22. Kullback S (1987) Letter to the editor: The Kullback–Leibler distance

  23. Zhuang F, Cheng X, Luo P, Pan SJ, He Q (2018) Supervised representation learning with double encoding-layer autoencoder for transfer learning. ACM Trans Intell Syst Technol (TIST) 9(2):16

    Google Scholar 

  24. Chavarriaga R, Sagha H, Calatroni A, Digumarti ST, Tröster G, Millán JDR, Roggen D (2013) The opportunity challenge: a benchmark database for on-body sensor-based activity recognition. Pattern Recognit Lett 34(15):2033–2042

    Article  Google Scholar 

  25. Barshan B, Yüksek MC (2014) Recognizing daily and sports activities in two open source machine learning environments using body-worn sensor units. Comput J 57(11):1649–1667

    Article  Google Scholar 

  26. Hu L, Chen Y, Wang J, Hu C, Jiang X (2018) Okrelm: online kernelized and regularized extreme learning machine for wearable-based activity recognition. Int J Mach Learn Cybern 9(9):1577–1590

    Article  Google Scholar 

  27. Kingma DP, Ba J (2014) Adam: a method for stochastic optimization. [arXiv:1412.6980]

  28. Chang C-C, Lin C-J (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol (TIST) 2(3):27

    Google Scholar 

  29. Pan SJ, Tsang IW, Kwok JT, Yang Q (2011) Domain adaptation via transfer component analysis. IEEE Trans Neural Netw 22(2):199–210

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by Hankuk University of Foreign Studies Research Fund, and the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (2018R1D1A1B07047241).

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Bernardo Nugroho Yahya or Seok-Lyong Lee.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Prabono, A.G., Yahya, B.N. & Lee, SL. Hybrid domain adaptation for sensor-based human activity recognition in a heterogeneous setup with feature commonalities. Pattern Anal Applic 24, 1501–1511 (2021). https://doi.org/10.1007/s10044-021-00995-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10044-021-00995-9

Keywords

Navigation