Abstract
With the rapidly growing use of smart phones it becomes easier for people to document social events. Parts of the multimedia content are shared on social networks like Facebook, while others stay private on the users’ phones. Friends also add content of the same event to Facebook. The media content of social events is becoming scattered over different accounts and becomes increasingly difficult for the user to re-collect, especially with the absence of the EXIF-header in Facebook. In this paper, we introduce an approach that supports the users in automatically detecting distributed event content after selecting very few photos and videos on the phone. We use the metadata of the content on the phone to increase the initial seeds, and then we exploit a novel face recognition approach using the social context, and a probabilistic fusion model to detect the distributed media content between several social contacts on Facebook to the respective events. Our event content detection significantly outperforms other approaches that give poor result in metadata-unfriendly environment such as Facebook.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
http://royal.pingdom.com/2011/01/12/internet-2010-in-numbers/
Chatzichristofis, S.A., Boutalis, Y.S.: CEDD: Color and edge directivity descriptor: A compact descriptor for image indexing and retrieval. In: Gasteratos, A., Vincze, M., Tsotsos, J.K. (eds.) ICVS 2008. LNCS, vol. 5008, pp. 312–322. Springer, Heidelberg (2008)
Chen, L., Hu, B.: Face annotation for family photo album management. Int. Journal of Image and Graphics (2003)
Gkalelis, N., Mezaris, V., Kompatsiaris, I.: A joint content-event model for event-centric multimedia indexing. In: ICSC, pp. 79–84. IEEE (2010)
Ke, Y., Sukthankar, R., Huston, L., Ke, Y., Sukthankar, R.: Efficient near-duplicate detection and sub-image retrieval. In: ACM Multimedia, pp. 869–876 (2004)
Li, Z., Luo, H., Fan, J.: Incorporating camera metadata for attended region detection and consumer photo classification. In: Proc. of the 17th ACM Int. Conf. on Multimedia, MM 2009 (2009)
Liu, X., Troncy, R., Huet, B.: Finding media illustrating events. In: Proc. Int. Conf. Multimedia Retrieval, ICMR 2011 (2011)
Mavridis, N., Kazmi, W., Toulis, P., Ben-Abdelkader, C.: On the synergies between online social networking, face recognition and interactive robotics. In: Proc. of the 2009 Int. Conf. on Computational Aspects of Social Networks (2009)
Petkos, G., Papadopoulos, S., Kompatsiaris, Y.: Social event detection using multimodal clustering and integrating supervisory signals. In: Proceedings of the 2nd ACM International Conference on Multimedia Retrieval, ICMR 2012, pp. 23:1–23:8 (2012)
Rabbath, M., Sandhaus, P., Boll, S.: Analysing facebook features to support event detection for photo-based facebook applications. In: Proc. of the ACM Int. Conf. on Multimedia Retrieval, ICMR 2012. ACM (2012)
Stone, Z., Zickler, T., Darrell, T.: Toward Large-Scale Face Recognition Using Social network Context. Proceedings of the IEEE 98(8), 1408–1415 (2010)
Troncy, R., Malocha, B., Fialho, A.T.S.: Linking events with media. In: Proc. of the 6th Int. Conf. on Semantic Systems, I-SEMANTICS (2010)
Wang, G., Gallagher, A., Luo, J., Forsyth, D.: Seeing people in social context: Recognizing people and social relationships. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part V. LNCS, vol. 6315, pp. 169–182. Springer, Heidelberg (2010)
Wu, Z., Ke, Q., Sun, J., Shum, H.-Y.: Scalable face image retrieval with identity-based quantization and multireference reranking. IEEE Trans. Pattern Anal. Mach. Intell.
Zeng, X., Xie, X., Wang, K.: Instant video summarization during shooting with mobile phone. In: Proc. of the 1st ACM Int. Conf. on Multimedia Retrieval, ICMR 2011 (2011)
Zhang, L., Chen, L., Li, M., Zhang, H.: Automated annotation of human faces in family albums. In: Proc. of the Eleventh ACM Int. Conf. on Multimedia, MULTIMEDIA 2003 (2003)
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Rabbath, M., Boll, S. (2014). Personal Media Reunion: Re-collecting Media Content Scattered over Smart Devices and Social Networks. In: Gurrin, C., Hopfgartner, F., Hurst, W., Johansen, H., Lee, H., O’Connor, N. (eds) MultiMedia Modeling. MMM 2014. Lecture Notes in Computer Science, vol 8325. Springer, Cham. https://doi.org/10.1007/978-3-319-04114-8_16
Download citation
DOI: https://doi.org/10.1007/978-3-319-04114-8_16
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-04113-1
Online ISBN: 978-3-319-04114-8
eBook Packages: Computer ScienceComputer Science (R0)