Andrea Ceroni
Nattiya Kanhabua
ABSTRACT
When selecting important photos from a personal photo collection - e.g. for creating an enjoyable sub-collection for revisiting or preservation - photos are not considered in isolation. Therefore, collection-level criteria are also taken into account by automated photo selection methods. However, the typical two-step process of first clustering and subsequently picking from the clusters seems to overstress coverage as a criterion when applied to the task of selecting the photos most important to a user. We, therefore, propose a novel expectation-oriented photo selection method, which combines a variety of collection-level and image-level selection criteria in a flexible way. In our evaluation, which is based on large real-world personal photo collections with overall more than 18,000 images, we show that our method outperforms state-of-the-art photo selection methods. In addition, the proposed method does not rely on any manual annotations, making it applicable in realistic settings of personal photo collections.
- K. Apostolidis, C. Papagiannopoulou, and V. Mezaris. CERTH at MediaEval 2014 synchronization of multi-user event media task. In Proc. of MediaEval 2014 Workshop, 2014.Google Scholar
- R. Arandjelovic and A. Zisserman. All about vlad. In Proc. of CVPR '13, 2013. Google ScholarDigital Library
- W.-T. Chu and C.-H. Lin. Automatic selection of representative photo and smart thumbnailing using near-duplicate detection. In Proc. of MM '08, 2008. Google ScholarDigital Library
- M. Cooper, J. Foote, A. Girgensohn, and L. Wilcox. Temporal event clustering for digital photo collections. In ACM TOMCCAP, 2005. Google ScholarDigital Library
- C. Cortes and V. Vapnik. Support-vector networks. Mach. Learn., 20(3):273--297, 1995. Google ScholarDigital Library
- M.-S. Dao, A.-D. Duong, and F. G. De Natale. Unsupervised social media events clustering using user-centric parallel split-n-merge algorithms. In Proc. of ICASSP '14, 2014.Google ScholarCross Ref
- H. Jégou, F. Perronnin, M. Douze, J. Sánchez, P. Pérez, and C. Schmid. Aggregating local image descriptors into compact codes. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 2012. Google ScholarDigital Library
- N. Kanhabua, C. Niederée, and W. Siberski. Towards concise preservation by managed forgetting: Research issues and case study. In Proc. of iPres '13, 2013.Google Scholar
- C. Li, A. C. Loui, and T. Chen. Towards aesthetics: A photo quality assessment and photo selection system. In Proc. of MM '10, 2010. Google ScholarDigital Library
- J. Li, J. H. Lim, and Q. Tian. Automatic summarization for personal digital photos. In Proc. of ICICS-PCM '03, 2003.Google Scholar
- F. Markatopoulou, N. Pittaras, O. Papadopoulou, V. Mezaris, and I. Patras. A study on the use of a binary local descriptor and color extensions of local descriptors for video concept detection. In MultiMedia Modeling, 2015.Google ScholarCross Ref
- E. Mavridaki and V. Mezaris. No-reference blur assessment in natural images using fourier transform and spatial pyramids. In Proc. of ICIP '14, 2014.Google ScholarCross Ref
- P. Over, G. Awad, M. Michel, J. Fiscus, G. Sanders, W. Kraaij, A. F. Smeaton, and G. Quéenot. Trecvid 2013 - an overview of the goals, tasks, data, evaluation mechanisms and metrics. In TRECVID 2013, 2013.Google Scholar
- M. Rabbath, P. Sandhaus, and S. Boll. Automatic creation of photo books from stories in social media. ACM TOMM, 2011. Google ScholarDigital Library
- S. Roy and S. K. Bandyophadyay. Face detection using a hybrid approach that combines hsv and rgb. IJCSMC, 2013.Google Scholar
- A. E. Savakis, S. P. Etz, and A. C. P. Loui. Evaluation of image appeal in consumer photography. 2000.Google Scholar
- B.-S. Seah, S. S. Bhowmick, and A. Sun. Prism: Concept-preserving social image search results summarization. In Proc. of SIGIR '14, 2014. Google ScholarDigital Library
- P. Sinha, S. Mehrotra, and R. Jain. Summarization of personal photologs using multidimensional content and context. In Proc. of ICMR '11, 2011. Google ScholarDigital Library
- K. E. Van De Sande, T. Gevers, and C. G. Snoek. Evaluating color descriptors for object and scene recognition. IEEE TPAMI, 2010. Google ScholarDigital Library
- P. Viola and M. J. Jones. Robust real-time face detection. Proc. of IJCV, 2004. Google ScholarDigital Library
- T. Walber, A. Scherp, and S. Staab. Smart photo selection: Interpret gaze as personal interest. In Proc. of CHI '14, 2014. Google ScholarDigital Library
- M.-N. Wu, C.-C. Lin, and C.-C. Chang. Novel image copy detection with rotating tolerance. Journal of Systems and Software, 80, 2007. Google ScholarDigital Library
- C.-H. Yeh, Y.-C. Ho, B. A. Barsky, and M. Ouhyoung. Personalized photograph ranking and selection system. In Proc. of MM '10, 2010. Google ScholarDigital Library
- W. Zhou, H. Li, Y. Lu, and Q. Tian. Large scale image search with geometric coding. In MM '11, 2011. Google ScholarDigital Library
Index Terms
- To Keep or not to Keep: An Expectation-oriented Photo Selection Method for Personal Photo Collections
Recommendations
Image Selection in Photo Albums
ICMR '18: Proceedings of the 2018 ACM on International Conference on Multimedia RetrievalThe selection of the best photos in personal albums is a task that is often faced by photographers. This task can become laborious when the photo collection is large and it contains multiple similar photos. Recent advances on image aesthetics and photo ...
Smart photo selection: interpret gaze as personal interest
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsManually selecting subsets of photos from large collections in order to present them to friends or colleagues or to print them as photo books can be a tedious task. Today, fully automatic approaches are at hand for supporting users. They make use of ...
Context in Photo Albums: Understanding and Modeling User Behavior in Clustering and Selection
Recent progress in digital photography and storage availability has drastically changed our approach to photo creation. While in the era of film cameras, careful forethought would usually precede the capture of a photo; nowadays, a large number of ...
Comments