Abstract
The evaluation of computer vision and pattern recognition systems is usually a burdensome and time-consuming activity. In this chapter all the benchmarks publicly available for re-identification will be reviewed and compared, starting from the ancestors VIPeR and Caviar to the most recent datasets for 3D modeling such as SARC3d (with calibrated cameras) and RGBD-ID (with range sensors). Specific requirements and constraints are highlighted and reported for each of the described collections. In addition, details on the metrics that are mostly used to test and evaluate the re-identification systems are provided.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Phillips, P., Moon, H., Rauss, P., Rizvi, S.: The feret evaluation methodology for face-recognition algorithms. In: Proceedings of IEEE International Conference on Computer Vision and, Pattern Recognition, pp. 137–143 (1997)
Maio, D., Maltoni, D., Cappelli, R., Wayman, J., Jain, A.: Fvc 2000: fingerprint verification competition. IEEE Trans. Pattern Anal. Mach. Intell. 24(3), 402–412 (2002)
Gray, D., Brennan, S., Tao, H.: Evaluating appearance models for recognition, reacquisition, and tracking. In: Proceedings of 10th IEEE International Workshop on Performance Evaluation of Tracking and Surveillance (PETS) (2007)
Nilski, A.: Evaluating multiple camera tracking systems—the i-lids 5th scenario. In: Security Technology, 2008. ICCST 2008. 42nd Annual IEEE International Carnahan Conference on, pp. 277–279 (2008)
Cheng, D.S., Cristani, M., Stoppa, M., Bazzani, L., Murino, V.: Custom pictorial structures for re-identification. In: British Machine Vision Conference (BMVC 2011), pp. 68.1–68.11. BMVA Press (2011)
Schwartz, W., Davis, L.: Learning discriminative appearance-based models using partial least squares. In: Proceedings of the XXII Brazilian Symposium on Computer Graphics and Image Processing (2009)
Baltieri, D., Vezzani, R., Cucchiara, R.: Sarc3d: a new 3d body model for people tracking and re-identification. In: Proceedings of IEEE International Conference on Image Analysis and Processing, pp. 197–206. Ravenna (2011)
Baltieri, D., Vezzani, R., Cucchiara, R.: 3dpes: 3d people dataset for surveillance and forensics. In: Proceedings of the 1st International ACM Workshop on Multimedia Access to 3D Human Objects. Scottsdale (2011)
Smeaton, A.F., Over, P., Kraaij, W.: Evaluation campaigns and trecvid. In: MIR ’06: Proceedings of the 8th ACM International Workshop on Multimedia Information Retrieval, pp. 321–330. New York (2006)
Pets: performance evaluation of tracking and surveillance (2000–2009). http://www.cvg.cs.rdg.ac.uk/slides/pets.html
Hirzer, M., Beleznai, C., Roth, P.M., Bischof, H.: Person re-identification by descriptive and discriminative classification. In: Proceedings Scandinavian Conference on Image Analysis (2011). www.springerlink.com
Li, W., Wu, Y., Mukunoki, M., Minoh, M.: Common-near-neighbor analysis for person re-identification. In: Internationl Conference on Image Processing, pp. 1621–1624 (2012)
Loy, C.C., Xiang, T., Gong, S.: Multi-camera activity correlation analysis. In: IEEE Conference on Computer Vision and, Pattern Recognition, pp. 1988–1995 (2009)
Bialkowski, A., Denman, S., Sridharan, S., Fookes, C., Lucey, P.: A database for person re-identification in multi-camera surveillance networks. In: DICTA, pp. 1–8. IEEE (2012)
Barbosa, I.B., Cristani, M., Bue, A.D., Bazzani, L., Murino, V.: Re-identification with rgb-d sensors. In: Fusiello, A., Murino, V., Cucchiara, R. (eds.) First International ECCV Workshop on Re-Identification, Lecture Notes in Computer Science, vol. 7583, pp. 433–442. Springer (2012)
Vezzani, R., Cucchiara, R.: Video surveillance online repository (visor): an integrated framework. Multimedia Tools Appl. 50(2), 359–380 (2010)
project, C.: Video and image datasets index. online (2008). http://www.multitel.be/cantata/
Bak, S., Corvee, E., Bremond, F., Thonnat, M.: Multiple-shot human re-identification by mean riemannian covariance grid. In: Proceedings of IEEE Conference on Advanced Video and Signal-Based Surveillance, pp. 179–184 (2011)
Brosser, B., Zheng, W., Gong, S., Xiang, T.: Person re-identification by support vector ranking. In: Proceedings of British Machine Vision Conference, pp. 21.1–2111 (2010)
Zheng, W.S., Gong, S., Xiang, T.: Person re-identification by probabilistic relative distance comparison. In: Proceedings of IEEE International Conference on Computer Vision and, Pattern Recognition, pp. 649–656 (2011)
Ess, A., Leibe, B., Gool, L.V.: Depth and appearance for mobile scene analysis. In: Proceedings IEEE International Conference on Computer Vision (2007)
Li, W., Zhao, R., Wang, X.: Human reidentification with transferred metric learning. In: Proceedings of Asian Conference on Computer Vision 2012 (2012)
Frontex: Application of surveillance tools to border surveillance - concept of operations. online (2011).
AmigÃş, E., Gonzalo, J., Artiles, J., Verdejo, F.: A comparison of extrinsic clustering evaluation metrics based on formal constraints. Inf. Retrieval 12, 461–486 (2009)
Hamdoun, O., Moutarde, F., Stanciulescu, B., Steux, B.: Person re-identification in multi-camera system by signature based on interest point descriptors collected on short video sequences. In: Proceedings of International Conference on Distributed Smart Cameras, pp. 1–6. IEEE (2008)
Nghiem, A., Bremond, F., Thonnat, M., Valentin, V.: Etiseo, performance evaluation for video surveillance systems. In: Proceedings of IEEE Conference on Advanced Video and Signal-Based Surveillance, pp. 476–481 (2007)
Leung, V., Orwell, J., Velastin, S.A.: Performance evaluation of re-acquisition methods for public transport surveillance. In: Proceedings of International Conference on Control, Automation, Robotics and Vision, pp. 705–712. IEEE (2008)
Gray, D., Tao, H.: Viewpoint invariant pedestrian recognition with an ensemble of localized features. In: Proceedings of European Conference on Computer Vision, p. 262 (2008)
Mignon, A., Jurie, F.: Pcca: a new approach for distance learning from sparse pairwise constraints. In: Proceedings of IEEE International Conference on Computer Vision and, Pattern Recognition, pp. 2666–2672 (2012)
Jungling, K., Arens, M.: Local feature based person reidentification in infrared image sequences. In: Proceedings of IEEE Conference on Advanced Video and Signal-Based Surveillance, pp. 448–455 (2010)
Meuwly, D.: Forensic individualization from biometric data. Sci. Justice 46(4), 205–213 (2006)
Gonzalez-rodriguez, J., Fierrez-aguilar, J., Ortega-Garcia, J.: Forensic identification reporting using automatic speaker recognition systems. In: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP, pp. 93–96 (2003)
Balding, D.: Weight-of-Evidence for Forensic DNA Profiles. Wiley, Chichester (2005)
Ali, T., Veldhuis, R., Spreeuwers, L.: Forensic face recognition: a survey (2010)
Metternich, M., Worring, M., Smeulders, A.: Color Based Tracing in Real-Life Surveillance Data. Trans. Data Hiding Multimedia Secur. V 6010, 18–33 (2010)
Bazzani, L., Cristani, M., Murino, V.: Symmetry-driven accumulation of local features for human characterization and re-identification. Comput. Vis. Image Underst. 117(2), 130–144 (2013)
Hirzer, M., Roth, P.M., Köstinger, M., Bischof, H.: Relaxed pairwise learned metric for person re-identification. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Lecture Notes in Computer Science, vol. 7577, pp. 780–793. Springer, Berlin Heidelberg (2012)
Ali, S., Javed, O., Haering, N., Kanade, T.: Interactive retrieval of targets for wide area surveillance. In: Proceedings of the ACM International Conference on Multimedia, pp. 895–898. ACM, New York (2010)
Imageclef. http://www.imageclef.org/ (2013)
Over, P., Awad, G., Michel, M., Fiscus, J., Kraaij, W., Smeaton, A.F.: Trecvid 2011—an overview of the goals, tasks, data, evaluation mechanisms and metrics. In: Proceedings of TRECVID 2011. NIST, USA (2011)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer-Verlag London
About this chapter
Cite this chapter
Vezzani, R., Cucchiara, R. (2014). Benchmarking for Person Re-identification. In: Gong, S., Cristani, M., Yan, S., Loy, C. (eds) Person Re-Identification. Advances in Computer Vision and Pattern Recognition. Springer, London. https://doi.org/10.1007/978-1-4471-6296-4_16
Download citation
DOI: https://doi.org/10.1007/978-1-4471-6296-4_16
Published:
Publisher Name: Springer, London
Print ISBN: 978-1-4471-6295-7
Online ISBN: 978-1-4471-6296-4
eBook Packages: Computer ScienceComputer Science (R0)