Skip to main content
SpringerLink
Log in

Adaptive weight part-based convolutional network for person re-identification

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

While part-based methods have been shown effective in the person re-identification task, it is unreasonable for most of them to treat each part equally, due to the retrieved image may be affected by deformation, occlusion and other factors, which makes the feature information of some parts unreliable. Instead of using the same weight of each part for the final person re-ID, we consider using an adaptive weight based on the part image information for each part for precise person retrieval. Specifically, we aim at learning discriminative part-informed features and propose an adaptive weight part-based convolutional network (AWPCN) for the person re-ID task. The core component of our AWPCN framework is an adaptive weight model, in which the part-based convolutional network and the adaptive weight model are used for feature refinement and feature-pair alignment, respectively. Given an image input at first, it outputs a convolutional descriptor consisting of several part-level features by the part-based convolutional network. And then, the corresponding weights of each part are determined by the adaptive weight model. Finally, we can use the adaptive weight part-based convolutional network joint to train each part loss and simultaneous optimization of its feature representations. We evaluate the proposed AWPCN model on Market-1501, DukeMTMC-reID and CUHK03 datasets. In extensive experiments, the AWPCN model outperforms most of the state-of-the-art methods on these representative datasets which clearly demonstrates the effectiveness of our proposed method. Our code will be released at https://github.com/deasonyuan/AWPCN.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Bedagkar-Gala A, Shah SK (2014) A survey of approaches and trends in person re-identification. Image Vis Comput 32(4):270–286

    Article  Google Scholar 

  2. Chang X, Hospedales TM, Tao X (2018) Multi-level factorisation net for person re-identification. In: Computer vision and pattern recognition, pp 2109–2118

  3. Chen W, Chen X, Zhang J, Huang K (2017) Beyond triplet loss: a deep quadruplet network for person re-identification. In: Computer vision and pattern recognition, pp 1320–1329

  4. Chen Y, Zhu X, Gong S (2017) Person re-identification by deep learning multi-scale representations. In: International conference on computer vision workshop, pp 2590–2600

  5. Chi S, Li J, Zhang S, Xing J, Wen G, Qi T (2017) Pose-driven deep convolutional model for person re-identification. In: International conference on computer vision, pp 3960–3969

  6. Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: Computer vision and pattern recognition, pp 886–893

  7. Geng S, Yu M, Liu Y, Yu Y, Bai J (2019) Re-ranking pedestrian re-identification with multiple metrics. Multimed Tools Appl 78(9):11631–11653

    Article  Google Scholar 

  8. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Computer vision and pattern recognition, pp 770–778

  9. Hermans A, Beyer L, Leibe B (2017) Defense of the triplet loss for person re-identification. arXiv:1703.07737

  10. Hirzer M, Roth PM, K?stinger M, Bischof H (2012) Relaxed pairwise learned metric for person re-identification. In: European conference on computer vision, pp 780–793

  11. Huang H, Li D, Zhang Z, Chen X, Huang K (2018) Adversarially occluded samples for person re-identification. In: Computer vision and pattern recognition, pp 5098–5107

  12. Jia J, Ruan Q, An G, Yi J (2017) Multiple metric learning with query adaptive weights and multi-task re-weighting for person re-identification. Comput Vis Image Underst 160:87–99

    Article  Google Scholar 

  13. Jing X, Rui Z, Feng Z, Wang H, Ouyang W (2018) Attention-aware compositional network for person re-identification. In: Computer vision and pattern recognition, pp 2119–2128

  14. Kuo CH, Khamis S, Shet V (2013) Person re-identification using semantic color names and rankboost. In: IEEE workshop on applications of computer vision, pp 281–287

  15. Lavi B, Serj MF, Ullah I (2018) Survey on deep learning techniques for person re-identification task. arXiv:1807.05284

  16. Li D, Chen X, Zhang Z, Huang K (2017) Learning deep context-aware features over body and latent parts for person re-identification. In: Computer vision and pattern recognition, pp 384–393

  17. Liu X, Zhao H, Tian M, Lu S, Wang X (2017) Hydraplus-net: attentive deep features for pedestrian analysis. In: International conference on computer vision, pp 350–359

  18. Lowe DG (1999) Object recognition from local scale-invariant features. In: International conference on computer vision, pp 1150–1157

  19. Ma F, Zhu X, Zhang X, Yang L, Zuo M, Jing X-Y (2019) Low illumination person re-identification. Multimed Tools Appl 78(1):337–362

    Article  Google Scholar 

  20. Matsukawa T, Suzuki E (2016) Person re-identification using cnn features learned from combination of attributes. In: International conference on pattern recognition, pp 2428–2433

  21. Pedagadi S, Orwell J, Velastin S, Boghossian B (2013) Local fisher discriminant analysis for pedestrian re-identification. In: Computer vision and pattern recognition, pp 3318–3325

  22. Sarfraz MS, Schumann A, Eberle A, Stiefelhagen R (2018) A pose-sensitive embedding for person re-identification with expanded cross neighborhood re-ranking. In: Computer vision and pattern recognition, pp 420–429

  23. Satta R (2013) Appearance descriptors for person re-identification: a comprehensive review. arXiv:1307.5748

  24. Shen Y, Li H, Xiao H, Yi S, Chen D, Wang X (2018) Deep group-shuffling random walk for person re-identification. In: Computer vision and pattern recognition, pp 2265–2274

  25. Si J, Zhang H, Li CG, Guo J (2018) Spatial pyramid-based statistical features for person re-identification: a comprehensive evaluation. IEEE Trans Sys Man Cybern Sys 48(7):1140–1154

    Article  Google Scholar 

  26. Si J, Zhang H, Li CG, Kuen J, Gang W (2018) Dual attention matching network for context-aware feature sequence based person re-identification. In: Computer vision and pattern recognition, pp 5363–5372

  27. Song B, Xiang B, Qi T (2017) Scalable person re-identification on supervised smoothed manifold. In: Computer vision and pattern recognition, pp 2530–2539

  28. Sun Y, Liang Z, Yi Y, Qi T, Wang S (2018) Beyond part models: Person retrieval with refined part pooling (and a strong convolutional baseline). In: European conference on computer vision, pp 501–518

  29. Sun Y, Xu Q, Li Y, Zhang C, Li Y, Wang S, Sun J (2019) Perceive where to focus: learning visibility-aware part-level features for partial person re-identification. arXiv:1904.00537

  30. Sun Y, Zheng L, Deng W, Wang S (2017) Svdnet for pedestrian retrieval. In: International conference on computer vision, pp 3820–3828

  31. Tao D, Jin L, Wang Y, Yuan Y, Li X (2013) Person re-identification by regularized smoothing kiss metric learning. IEEE Trans Circ Sys Video Technol 23 (10):1675–1685

    Article  Google Scholar 

  32. Tian C, Fei L, Zheng W, Xu Y, Zuo W, Lin C-W (2019) Deep learning on image denoising: an overview. arXiv:1912.13171

  33. Tian C, Xu Y, Li Z, Zuo W, Fei L, Liu H (2020) Attention-guided cnn for image denoising. Neural Networks. https://doi.org/10.1016/j.neunet.2019.12.024

  34. Tian C, Xu Y, Zuo W (2020) Image denoising using deep cnn with batch renormalization. Neural Netw 121:461–473

    Article  Google Scholar 

  35. Varior RR, Haloi M, Gang W (2016) Gated siamese convolutional neural network architecture for human re-identification. In: European conference on computer vision, pp 791–808

  36. Varior RR, Shuai B, Lu J, Xu D, Wang G (2016) A siamese long short-term memory architecture for human re-identification. In: European conference on computer vision, pp 135–153

  37. Wei L, Rui Z, Tong X, Wang XG (2014) Deepreid: deep filter pairing neural network for person re-identification. In: Computer vision and pattern recognition, pp 152–159

  38. Wei L, Yang W, Li J (2017) Re-identification by neighborhood structure metric learning. Pattern Recogn 61:327–338

    Article  Google Scholar 

  39. Wei L, Zhu X, Gong S (2018) Harmonious attention network for person re-identification. In: Computer vision and pattern recognition, pp 2285–2294

  40. Yan W, Wang L, You Y, Xu Z, Weinberger KQ (2018) Resource aware person re-identification across multiple resolutions. In: Computer vision and pattern recognition, pp 8042–8051

  41. Yang Q, Yu H-X, Wu A, Zheng W-S (2019) Patch based discriminative feature learning for unsupervised person re-identification. In: Computer vision and pattern recognition

  42. Yang Y, Liao S, Zhen L, Li SZ (2016) Large scale similarity learning using similar pairs for person verification. In: Thirtieth AAAI conference on artificial intelligence, pp 3655–3661

  43. Yao H, Zhang S, Hong R, Zhang Y, Tian Q (2019) Deep representation learning with part loss for person re-identification. Trans Image Process 28(6):2860–2871

    Article  MathSciNet  Google Scholar 

  44. Yi D, Lei Z, Liao S, Li SZ (2014) Deep metric learning for person re-identification. In: International conference on pattern recognition, pp 34–39

  45. Yu HX, Zheng WS, Wu A, Guo X, Lai JH (2019) Unsupervised person re-identification by soft multilabel learning. arXiv:1903.06325

  46. Yuan D, Fan N, He Z (2020) Learning target-focusing convolutional regression model for visual object tracking. Knowledge-Based Systems. https://doi.org/10.1016/j.knosys.2020.105526

  47. Yuan D, Kang W, He Z (2020) Robust visual tracking with correlation filters and metric learning. Knowledge-Based Systems. https://doi.org/10.1016/j.knosys.2020.105697

  48. Yuan D, Li X, He Z, Liu Q, Lu S (2020) Visual object tracking with adaptive structural convolutional network. Knowledge-Based Systems. https://doi.org/10.1016/j.knosys.2020.105554

  49. Yuan D, Lu X, Li D, Liang Y, Zhang X (2019) Particle filter re-detection for visual tracking via correlation filters. Multimed Tools Appl 78(11):14277–14301

    Article  Google Scholar 

  50. Yuan D, Zhang X, Liu J, Li D (2019) A multiple feature fused model for visual object tracking via correlation filters. Multimed Tools Appl 78(19):27271–27290

    Article  Google Scholar 

  51. Zhang L, Xiang T, Gong S (2016) Learning a discriminative null space for person re-identification. In: Computer vision and pattern recognition, pp 1239–1248

  52. Zhao L, Xi L, Wang J, Zhuang Y (2017) Deeply-learned part-aligned representations for person re-identification. In: International conference on computer vision, pp 3219–3228

  53. Zheng L, Shen L, Tian L, Wang S, Wang J, Tian Q (2015) Scalable person re-identification: a benchmark. In: International conference on computer vision, pp 1116–1124

  54. Zheng L, Yang Y, Hauptmann AG (2016) Person re-identification: past, present and future. arXiv:1610.02984

  55. Zheng Z, Zheng L, Yang Y (2017) A discriminatively learned cnn embedding for person re-identification. ACM Transactions on Multimedia Computing Communications and Applications 14(1):13:1–13:20

    Google Scholar 

  56. Zheng Z, Zheng L, Yang Y (2017) Unlabeled samples generated by gan improve the person re-identification baseline in vitro. In: International conference on computer vision, pp 3774–3782

  57. Zhong Z, Zheng L, Cao D, Li S (2017) Re-ranking person re-identification with k-reciprocal encoding. In: Computer vision and pattern recognition, pp 384–393

  58. Zhong Z, Zheng L, Zheng Z, Li S, Yang Y (2018) Camera style adaptation for person re-identification. In: Computer vision and pattern recognition, pp 5157–5166

  59. Zhu F, Kong X, Wu Q, Fu H, Li M (2018) A loss combination based deep model for person re-identification. Multimed Tools Appl 77(3):3049–3069

    Article  Google Scholar 

Download references

Acknowledgments

This work was supported by the National Natural Science Foundation of China (Grant No. 61672183), by the Natural Science Foundation of Guangdong Province (Grant No. 2015A030313544), by the Shenzhen Research Council (Grant No. JCYJ20170413104556946, JCYJ20170815113552036), and by the project ”The Verification Platform of Multi-tier Coverage Communication Network for Oceans (PCL2018KP002)”. Di Yuan is supported by a scholarship from China Scholarship Council (CSC).

Author information

Author notes

    Authors and Affiliations

    1. School of Science, Harbin Institute of Technology, Shenzhen, China

      Xiu Shu

    2. School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen, China

      Di Yuan & Qiao Liu

    3. College of Finance and Statistics, Hunan University, Changsha, China

      Jiaqi Liu

    Authors
    1. Xiu Shu
      View author publications

      You can also search for this author in PubMed Google Scholar

    2. Di Yuan
      View author publications

      You can also search for this author in PubMed Google Scholar

    3. Qiao Liu
      View author publications

      You can also search for this author in PubMed Google Scholar

    4. Jiaqi Liu
      View author publications

      You can also search for this author in PubMed Google Scholar

    Corresponding author

    Correspondence to Di Yuan.

    Additional information

    Publisher’s note

    Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

    Xiu Shu and Di Yuan are contributed equally to this work and should be considered co-first authors

    Rights and permissions

    Reprints and permissions

    About this article

    Check for updates. Verify currency and authenticity via CrossMark

    Cite this article

    Shu, X., Yuan, D., Liu, Q. et al. Adaptive weight part-based convolutional network for person re-identification. Multimed Tools Appl 79, 23617–23632 (2020). https://doi.org/10.1007/s11042-020-09018-x

    Download citation

    • Received:

    • Revised:

    • Accepted:

    • Published:

    • Issue Date:

    • DOI: https://doi.org/10.1007/s11042-020-09018-x

    Keywords

    Search

    Navigation