Skip to main content

Attribute Based Approach for Clothing Recognition

  • Conference paper
  • First Online:
  • 2359 Accesses

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 663))

Abstract

Clothing recognition is hot topic for its potential benefits to lots of visual tasks, such as people identification, pose estimation and recommendation system. However, due to the wide variations of clothing appearance and the “semantic gap” between low-level features and high-level category concepts, clothing recognition is very challenging. To narrow this gap, a novel method, which uses intermediate attributes to bridge low-level features and high-level category labels, is proposed. This method first recognizes local attributes from low-level visual features, and then infers clothing category based on these attributes. To this end, DPM models and pixel-level parsing are applied to obtain geometric structure attributes, such as collar shape, and geometric size attributes, such as sleeve length, respectively. Then, Multiple Output Neural Networks are built to predict clothing category based on attributes. Experiments show that the performance of our method is superior to two state-of-the-art approaches on both of attribute and category recognition.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Yamaguchi, K., Kiapour, M.H., Berg, T.L.: Paper doll parsing: retrieving similar styles to parse clothing items. In: ICCV, pp. 3519–3526. IEEE (2013)

    Google Scholar 

  2. Liu, S., Feng, J., Domokos, C., Xu, H., Huang, J., Hu, Z., Yan, S.: Fashion parsing with weak color-category labels. IEEE Trans. Multimed. 16(1), 253–265 (2014)

    Article  Google Scholar 

  3. Chen, H., Xu, Z., Liu, Z.Q., Zhu, S.C.: Composite templates for cloth modeling and sketching. In: CVPR, vol. 1, pp. 943–950. IEEE (2006)

    Google Scholar 

  4. Chen, H., Gallagher, A., Girod, B.: Describing clothing by semantic attributes. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7574, pp. 609–623. Springer, Heidelberg (2012). doi:10.1007/978-3-642-33712-3_44

    Chapter  Google Scholar 

  5. Bossard, L., Dantone, M., Leistner, C., Wengert, C., Quack, T., Gool, L.: Apparel classification with style. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds.) ACCV 2012. LNCS, vol. 7727, pp. 321–335. Springer, Heidelberg (2013). doi:10.1007/978-3-642-37447-0_25

    Chapter  Google Scholar 

  6. Anguelov, D., Lee, K., Gökturk, S.B., Sumengen, B.: Contextual identity recognition in personal photo albums. In: CVPR, pp. 1–7. IEEE (2007)

    Google Scholar 

  7. Lin, D., Kapoor, A., Hua, G., Baker, S.: Joint people, event, and location recognition in personal photo collections using cross-domain context. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010. LNCS, vol. 6311, pp. 243–256. Springer, Heidelberg (2010). doi:10.1007/978-3-642-15549-9_18

    Chapter  Google Scholar 

  8. Zhang, W., Shen, J., Liu, G., Yu, Y.: A latent clothing attribute approach for human pose estimation. In: Cremers, D., Reid, I., Saito, H., Yang, M.-H. (eds.) ACCV 2014. LNCS, vol. 9003, pp. 146–161. Springer, Heidelberg (2015). doi:10.1007/978-3-319-16865-4_10

    Google Scholar 

  9. Shen, J., Liu, G., Chen, J., Fang, Y., Xie, J., Yu, Y., Yan, S.: Unified structured learning for simultaneous human pose estimation and garment attribute classification. IEEE Trans. Image Process. 23(11), 4786–4798 (2014)

    Article  MathSciNet  Google Scholar 

  10. Liu, S., Feng, J., Song, Z., Zhang, T., Lu, H., Xu, C., Yan, S.: Hi, magic closet, tell me what to wear! In: Proceedings of the 20th ACM International Conference on Multimedia, pp. 619–628. ACM (2012)

    Google Scholar 

  11. Kalantidis, Y., Kennedy, L., Li, L.: Getting the look: clothing recognition and segmentation for automatic product suggestions in everyday photos. In: Proceedings of the 3rd ACM Conference on International Conference on Multimedia Retrieval, pp. 105–112. ACM (2013)

    Google Scholar 

  12. Liu, S., Song, Z., Liu, G., Xu, C., Lu, H., Yan, S.: Street-to-shop: cross-scenario clothing retrieval via parts alignment and auxiliary set. In: CVPR, pp. 3330–3337. IEEE (2012)

    Google Scholar 

  13. Weber, M., Bäuml, M., Stiefelhagen, R.: Part-based clothing segmentation for person retrieval. In: 8th IEEE International Conference on Advanced Video Signal Based Surveillance, AVSS 2011, pp. 361–366. IEEE (2011)

    Google Scholar 

  14. Lorenzo-Navarro, J., Castrillón, M., Ramón, E., Freire, D.: Evaluation of LBP and HOG descriptors for clothing attribute description. In: Distante, C., Battiato, S., Cavallaro, A. (eds.) VAAM 2014. LNCS, vol. 8811, pp. 53–65. Springer, Heidelberg (2014). doi:10.1007/978-3-319-12811-5_4

    Google Scholar 

  15. Yang, M., Yu, K.: Real-time clothing recognition in surveillance videos. In: ICIP, pp. 2937–2940. IEEE (2011)

    Google Scholar 

  16. Li, L.-J., Su, H., Lim, Y., Fei-Fei, L.: Objects as attributes for scene classification. In: Kutulakos, K.N. (ed.) ECCV 2010. LNCS, vol. 6553, pp. 57–69. Springer, Heidelberg (2012). doi:10.1007/978-3-642-35749-7_5

    Chapter  Google Scholar 

  17. Fu, Y., Hospedales, T., Xiang, T., Gong, S.: Learning multimodal latent attributes. IEEE Trans. Pattern Anal. Mach. Intell. 36(2), 303–316 (2014)

    Article  Google Scholar 

  18. Yamaguchi, K., Okatani, T., Sudo, K., Murasaki, K., Taniguchi, Y.: Mix and match: joint model for clothing and attribute recognition. In: BMVC (2015)

    Google Scholar 

  19. Dong, J., Chen, Q., Xia, W., Huang, Z., Yan, S.: A deformable mixture parsing model with parselets. In: ICCV, pp. 3408–3415. IEEE (2013)

    Google Scholar 

  20. Yang, Y., Ramanan, D.: Articulated pose estimation with flexible mixtures-of-parts. In: CVPR, pp. 1385–1392. IEEE (2011)

    Google Scholar 

  21. Fan, W., Qiyang, Z., Baolin, Y., Tao, X.: Parsing fashion image into mid-level semantic parts based on chain-conditional random fields. IET Image Proc. 10(6), 456–463 (2016)

    Article  Google Scholar 

  22. Felzenszwalb, P.F., Girshick, R.B., McAllester, D., Ramanan, D.: Object detection with discriminatively trained part based models. IEEE Trans. Pattern Anal. Mach. Intell. 32(9), 1627–1645 (2010)

    Article  Google Scholar 

  23. Azizpour, H., Laptev, I.: Object detection using strongly-supervised deformable part models. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7572, pp. 836–849. Springer, Heidelberg (2012). doi:10.1007/978-3-642-33718-5_60

    Chapter  Google Scholar 

  24. Yamaguchi, K., Kiapour, M., Ortiz, L., Berg, T.: Parsing clothing in fashion photographs. In: CVPR, pp. 3570–3577. IEEE (2012)

    Google Scholar 

  25. Yang, W., Luo, P., Lin, L.: Clothing co-parsing by joint image segmentation and labeling. In: CVPR, pp. 3182–3189. IEEE (2014)

    Google Scholar 

  26. Karsoliya, S.: Approximating number of hidden layer neurons in multiple hidden layer bpnn architecture. Int. J. Eng. Trends Technol. 3(6), 713–717 (2012)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Wang Fan .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer Nature Singapore Pte Ltd.

About this paper

Cite this paper

Fan, W., Qiyang, Z., Qingjie, L., Baolin, Y. (2016). Attribute Based Approach for Clothing Recognition. In: Tan, T., Li, X., Chen, X., Zhou, J., Yang, J., Cheng, H. (eds) Pattern Recognition. CCPR 2016. Communications in Computer and Information Science, vol 663. Springer, Singapore. https://doi.org/10.1007/978-981-10-3005-5_30

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-3005-5_30

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-3004-8

  • Online ISBN: 978-981-10-3005-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics