Abstract
Clothing recognition is hot topic for its potential benefits to lots of visual tasks, such as people identification, pose estimation and recommendation system. However, due to the wide variations of clothing appearance and the “semantic gap” between low-level features and high-level category concepts, clothing recognition is very challenging. To narrow this gap, a novel method, which uses intermediate attributes to bridge low-level features and high-level category labels, is proposed. This method first recognizes local attributes from low-level visual features, and then infers clothing category based on these attributes. To this end, DPM models and pixel-level parsing are applied to obtain geometric structure attributes, such as collar shape, and geometric size attributes, such as sleeve length, respectively. Then, Multiple Output Neural Networks are built to predict clothing category based on attributes. Experiments show that the performance of our method is superior to two state-of-the-art approaches on both of attribute and category recognition.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Yamaguchi, K., Kiapour, M.H., Berg, T.L.: Paper doll parsing: retrieving similar styles to parse clothing items. In: ICCV, pp. 3519–3526. IEEE (2013)
Liu, S., Feng, J., Domokos, C., Xu, H., Huang, J., Hu, Z., Yan, S.: Fashion parsing with weak color-category labels. IEEE Trans. Multimed. 16(1), 253–265 (2014)
Chen, H., Xu, Z., Liu, Z.Q., Zhu, S.C.: Composite templates for cloth modeling and sketching. In: CVPR, vol. 1, pp. 943–950. IEEE (2006)
Chen, H., Gallagher, A., Girod, B.: Describing clothing by semantic attributes. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7574, pp. 609–623. Springer, Heidelberg (2012). doi:10.1007/978-3-642-33712-3_44
Bossard, L., Dantone, M., Leistner, C., Wengert, C., Quack, T., Gool, L.: Apparel classification with style. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds.) ACCV 2012. LNCS, vol. 7727, pp. 321–335. Springer, Heidelberg (2013). doi:10.1007/978-3-642-37447-0_25
Anguelov, D., Lee, K., Gökturk, S.B., Sumengen, B.: Contextual identity recognition in personal photo albums. In: CVPR, pp. 1–7. IEEE (2007)
Lin, D., Kapoor, A., Hua, G., Baker, S.: Joint people, event, and location recognition in personal photo collections using cross-domain context. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010. LNCS, vol. 6311, pp. 243–256. Springer, Heidelberg (2010). doi:10.1007/978-3-642-15549-9_18
Zhang, W., Shen, J., Liu, G., Yu, Y.: A latent clothing attribute approach for human pose estimation. In: Cremers, D., Reid, I., Saito, H., Yang, M.-H. (eds.) ACCV 2014. LNCS, vol. 9003, pp. 146–161. Springer, Heidelberg (2015). doi:10.1007/978-3-319-16865-4_10
Shen, J., Liu, G., Chen, J., Fang, Y., Xie, J., Yu, Y., Yan, S.: Unified structured learning for simultaneous human pose estimation and garment attribute classification. IEEE Trans. Image Process. 23(11), 4786–4798 (2014)
Liu, S., Feng, J., Song, Z., Zhang, T., Lu, H., Xu, C., Yan, S.: Hi, magic closet, tell me what to wear! In: Proceedings of the 20th ACM International Conference on Multimedia, pp. 619–628. ACM (2012)
Kalantidis, Y., Kennedy, L., Li, L.: Getting the look: clothing recognition and segmentation for automatic product suggestions in everyday photos. In: Proceedings of the 3rd ACM Conference on International Conference on Multimedia Retrieval, pp. 105–112. ACM (2013)
Liu, S., Song, Z., Liu, G., Xu, C., Lu, H., Yan, S.: Street-to-shop: cross-scenario clothing retrieval via parts alignment and auxiliary set. In: CVPR, pp. 3330–3337. IEEE (2012)
Weber, M., Bäuml, M., Stiefelhagen, R.: Part-based clothing segmentation for person retrieval. In: 8th IEEE International Conference on Advanced Video Signal Based Surveillance, AVSS 2011, pp. 361–366. IEEE (2011)
Lorenzo-Navarro, J., Castrillón, M., Ramón, E., Freire, D.: Evaluation of LBP and HOG descriptors for clothing attribute description. In: Distante, C., Battiato, S., Cavallaro, A. (eds.) VAAM 2014. LNCS, vol. 8811, pp. 53–65. Springer, Heidelberg (2014). doi:10.1007/978-3-319-12811-5_4
Yang, M., Yu, K.: Real-time clothing recognition in surveillance videos. In: ICIP, pp. 2937–2940. IEEE (2011)
Li, L.-J., Su, H., Lim, Y., Fei-Fei, L.: Objects as attributes for scene classification. In: Kutulakos, K.N. (ed.) ECCV 2010. LNCS, vol. 6553, pp. 57–69. Springer, Heidelberg (2012). doi:10.1007/978-3-642-35749-7_5
Fu, Y., Hospedales, T., Xiang, T., Gong, S.: Learning multimodal latent attributes. IEEE Trans. Pattern Anal. Mach. Intell. 36(2), 303–316 (2014)
Yamaguchi, K., Okatani, T., Sudo, K., Murasaki, K., Taniguchi, Y.: Mix and match: joint model for clothing and attribute recognition. In: BMVC (2015)
Dong, J., Chen, Q., Xia, W., Huang, Z., Yan, S.: A deformable mixture parsing model with parselets. In: ICCV, pp. 3408–3415. IEEE (2013)
Yang, Y., Ramanan, D.: Articulated pose estimation with flexible mixtures-of-parts. In: CVPR, pp. 1385–1392. IEEE (2011)
Fan, W., Qiyang, Z., Baolin, Y., Tao, X.: Parsing fashion image into mid-level semantic parts based on chain-conditional random fields. IET Image Proc. 10(6), 456–463 (2016)
Felzenszwalb, P.F., Girshick, R.B., McAllester, D., Ramanan, D.: Object detection with discriminatively trained part based models. IEEE Trans. Pattern Anal. Mach. Intell. 32(9), 1627–1645 (2010)
Azizpour, H., Laptev, I.: Object detection using strongly-supervised deformable part models. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7572, pp. 836–849. Springer, Heidelberg (2012). doi:10.1007/978-3-642-33718-5_60
Yamaguchi, K., Kiapour, M., Ortiz, L., Berg, T.: Parsing clothing in fashion photographs. In: CVPR, pp. 3570–3577. IEEE (2012)
Yang, W., Luo, P., Lin, L.: Clothing co-parsing by joint image segmentation and labeling. In: CVPR, pp. 3182–3189. IEEE (2014)
Karsoliya, S.: Approximating number of hidden layer neurons in multiple hidden layer bpnn architecture. Int. J. Eng. Trends Technol. 3(6), 713–717 (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Fan, W., Qiyang, Z., Qingjie, L., Baolin, Y. (2016). Attribute Based Approach for Clothing Recognition. In: Tan, T., Li, X., Chen, X., Zhou, J., Yang, J., Cheng, H. (eds) Pattern Recognition. CCPR 2016. Communications in Computer and Information Science, vol 663. Springer, Singapore. https://doi.org/10.1007/978-981-10-3005-5_30
Download citation
DOI: https://doi.org/10.1007/978-981-10-3005-5_30
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-3004-8
Online ISBN: 978-981-10-3005-5
eBook Packages: Computer ScienceComputer Science (R0)