Abstract
Identifying and naming living plants or animals is usually impossible for the general public and often a difficult task for professionals and naturalists. Bridging this gap is a key challenge towards enabling effective biodiversity information retrieval systems. This taxonomic gap was actually already identified as one of the main ecological challenges to be solved during the Rio de Janeiro United Nations “Earth Summit” in 1992. Since 2011, the LifeCLEF challenges conducted in the context of the CLEF evaluation forum have been boosting and evaluating the advances in this domain. Data collections with an unprecedented volume and diversity have been shared with the scientific community to allow repeatable and long-term experiments. This paper describes the methodology of the conducted evaluation campaigns as well as providing a synthesis of the main results and lessons learned along the years.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Baillie J, Hilton-Taylor C, Stuart SN (2004) 2004 IUCN red list of threatened species: a global species assessment. IUCN, Gland
Bakic V, Mouine S, Ouertani-Litayem S, Verroust-Blondet A, Yahiaoui I, Goëau H, Joly A (2013) Inria’s participation at imageclef 2013 plant identification task. In: CLEF (online working notes/labs/workshop)
Böttcher T, Schmidt C, Zellhöfer D, Schmitt I (2012) Btu dbis’plant identification runs at imageclef 2012. In: CLEF (online working notes/labs/workshop)
Cai J, Ee D, Pham B, Roe P, Zhang J (2007) Sensor network for the monitoring of ecosystem: bird species recognition. In: 3rd International conference on intelligent sensors, sensor networks and information, 2007. ISSNIP 2007. https://doi.org/10.1109/ISSNIP.2007.4496859
Chen Q, Abedini M, Garnavi R, Liang X (2014) Ibm research australia at lifeclef2014: plant identification task. In: Working notes of CLEF 2014 conference
Choi S (2015a) Fish identification in underwater video with deep convolutional neural network: snumedinfo at lifeclef fish task 2015. In: CLEF (working notes)
Choi S (2015b) Plant identification with deep convolutional neural network: snumedinfo at lifeclef plant identification task 2015. In: Working notes of CLEF 2015 conference
Dávid Papp FM, Szũcs G (2017) Image matching for individual recognition with sift, ransac and mcl. In: Working notes of CLEF 2017 (cross language evaluation forum)
Gaston KJ, O’Neill MA (2004) Automated species identification: why not? Philos Trans Roy Soc Lond B: Biol Sci 359(1444):655–667
Ghazi EAOM Berrin Yanikoglu, Ozdemir MC (2015) Sabanci-okan system in lifeclef 2015 plant identification competition. In: Working notes of CLEF 2015 conference
Glotin H, Clark C, LeCun Y, Dugan P, Halkias X, Sueur J (2013a) Proceedings of 1st workshop on machine learning for bioacoustics - ICML4B. ICML, Atlanta. http://sabiod.org/ICML4B2013_book.pdf
Glotin H, LeCun Y, Artières T, Mallat S, Tchernichovski HX O (2013b) Proceedings of neural information processing scaled for bioacoustics, from neurons to big data. NIPS International Conference, Tahoe. http://sabiod.org/nips4b
Goëau H, Bonnet P, Joly A, Boujemaa N, Barthélémy D, Molino JF, Birnbaum P, Mouysset E, Picard M (2011a) The imageclef 2011 plant images classification task. In: CLEF 2011
Goëau H, Bonnet P, Joly A, Boujemaa N, Barthelemy D, Molino JF, Birnbaum P, Mouysset E, Picard M (2011b) The CLEF 2011 plant images classification task. In: Petras V, Forner P, Clough P, Ferro N (eds) CLEF 2011 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1177/
Goëau H, Bonnet P, Joly A, Yahiaoui I, Barthélémy D, Boujemaa N, Molino JF (2012a) Imageclef2012 plant images identification task. In: CLEF 2012, Rome
Goëau H, Bonnet P, Joly A, Yahiaoui I, Barthelemy D, Boujemaa N, Molino JF (2012b) The ImageCLEF 2012 plant identification task. In: Forner P, Karlgren J, Womser-Hacker C, Ferro N (eds) CLEF 2012 working notes, CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1178/
Goëau H, Bonnet P, Joly A, Bakic V, Barthélémy D, Boujemaa N, Molino JF (2013a) The imageclef 2013 plant identification task. In: CLEF, Valencia
Goëau H, Joly A, Bonnet P, Bakic V, Barthélémy D, Boujemaa N, Molino JF (2013b) The imageclef plant identification task 2013. In: Proceedings of the 2nd ACM international workshop on multimedia analysis for ecological data. ACM, New York, pp 23–28
Goëau H, Joly A, Bonnet P, Selmi S, Molino JF, Barthélémy D, Boujemaa N (2014) The lifeclef 2014 plant images identification task. In: CLEF, Sheffield
Goëau H, Bonnet P, Joly A (2015) The lifeclef 2015 plant images identification task. In: CLEF, Toulouse
Goëau H, Bonnet P, Joly A (2016a) The lifeclef plant identification task 2016. In: CEUR-WS (ed) CLEF, Evora. CLEF2016 working notes
Goëau H, Glotin H, Vellinga W, Planqué R, Joly A (2016b) Lifeclef bird identification task 2016: the arrival of deep learning. In: Working notes of CLEF 2016 - conference and labs of the evaluation forum, Évora, 5–8 September, 2016, pp 440–449. http://ceur-ws.org/Vol-1609/16090440.pdf
Goëau H, Bonnet P, Joly A (2017a) Plant identification based on noisy web data: the amazing performance of deep learning (lifeclef 2017). CLEF working notes 2017
Goëau H, Glotin H, Vellinga W, Planquè B, Joly A (2017b) Lifeclef bird identification task 2017. In: Working notes of CLEF 2017 - conference and labs of the evaluation forum, Dublin, Ireland, September 11–14, 2017. http://ceur-ws.org/Vol-1866/invited_paper_8.pdf
Joalland P, Paris S, Glotin H (2014) Efficient instance-based fish species visual identification by global representation. In: Working notes for CLEF 2014 conference, Sheffield, September 15–18, 2014, pp 785–789. URL http://ceur-ws.org/Vol-1180/CLEF2014wn-Life-JoallandEt2014.pdf
Joly A, Champ J, Buisson O (2014a) Instance-based bird species identification with undiscriminant features pruning - lifeclef2014. In: Working notes of CLEF 2014 conference
Joly A, Goëau H, Bonnet P, Bakić V, Barbe J, Selmi S, Yahiaoui I, Carré J, Mouysset E, Molino JF, et al (2014b) Interactive plant identification based on social image data. Ecol Inf 23:22–34
Joly A, Lombardo JC, Champ J, Saloma A (2016) Unsupervised individual whales identification: spot the difference in the ocean. In: Working notes of CLEF 2016 (cross language evaluation forum)
Joly A, Goëau H, Glotin H, Spampinato C, Bonnet P, Vellinga WP, Lombardo JC, Planqué R, Palazzo S, Müller H (2017) Lifeclef 2017 lab overview: multimedia species identification challenges. In: International conference of the cross-language evaluation forum for European languages. Springer, Berlin, pp 255–274
Kahl S, Wilhelm-Stein T, Hussein H, Klinck H, Kowerko D, Ritter M, Eibl M (2017) Large-scale bird sound classification using convolutional neural networks. In: CLEF 2017
Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems, pp 1097–1105
Kumar N, Belhumeur PN, Biswas A, Jacobs DW, Kress WJ, Lopez IC, Soares JVB (2012) Leafsnap: a computer vision system for automatic plant species identification. In: European conference on computer vision, pp 502–516
Lasseck M (2015) Towards automatic large-scale identification of birds in audio recordings. In: Mothe J, Savoy J, Kamps J, Pinel-Sauvagnat K, Jones GJF, SanJuan E, Cappellato L, Ferro N (eds) Experimental IR meets multilinguality, multimodality, and interaction. Proceedings of the sixth international conference of the CLEF association (CLEF 2015). Lecture notes in computer science (LNCS) 9283. Springer, Heidelberg, pp 364–375
Lee DJ, Schoenberger RB, Shiozawa D, Xu X, Zhan P (2004) Contour matching for a fish recognition and migration-monitoring system. In: Optics east, international society for optics and photonics, pp 37–48
Nakayama H (2013) Nlab-utokyo at imageclef 2013 plant identification task. In: CLEF 2013
Nilsback ME, Zisserman A (2008) Automated flower classification over a large number of classes. In: Proceedings of the indian conference on computer vision, graphics and image processing
Sánchez J, Perronnin F, Mensink T, Verbeek J (2013) Image classification with the fisher vector: Theory and practice. Int J Comput Vis 105(3):222–245
Sevilla A, Glotin H (2017) Audio bird classification with inception-v4 extended with time-frequency attention mechanisms. In: Working notes CLEF 2017, conference of the evaluation forum, Dublin. http://ceur-ws.org/Vol-1866/paper_177.pdf
Silvertown J, Harvey M, Greenwood R, Dodd M, Rosewell J, Rebelo T, Ansine J, McConway K (2015) Crowdsourcing the identification of organisms: a case-study of ispot. ZooKeys (480):125
Spampinato C, Palazzo S, Joalland P, Paris S, Glotin H, Blanc K, Lingrand D, Precioso F (2016) Fine-grained object recognition in underwater visual data. Multimedia Tools Appl 75(3):1701–1720. https://doi.org/10.1007/s11042-015-2601-x
Stowell D, Wood M, Stylianou Y, Glotin H (2016) Bird detection in audio: a survey and a challenge. In: 26th IEEE international workshop on machine learning for signal proceedings, MLSP, pp 1–6. https://doi.org/10.1109/MLSP.2016.7738875
Sullivan BL, Aycrigg JL, Barry JH, Bonney RE, Bruns N, Cooper CB, Damoulas T, Dhondt AA, Dietterich T, Farnsworth A, et al (2014) The ebird enterprise: an integrated approach to development and application of citizen science. Biol Conserv 169:31–40
Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1–9
Towsey M, Planitz B, Nantes A, Wimmer J, Roe P (2012) A toolbox for animal call recognition. Bioacoustics 21(2):107–125
Trifa VM, Kirschel AN, Taylor CE, Vallejo EE (2008) Automated species recognition of antbirds in a mexican rainforest using hidden markov models. J Acoust Soc Am 123:2424
Voorhees EM, et al (1999) The trec-8 question answering track report. In: Trec, vol 99, pp 77–82
Zhuang P, Xing L, Liu Y, Guo S, Qiao Y (2017) Marine animal detection and recognition with advanced deep learning models. In: Working notes of CLEF 2017
Acknowledgements
The organization of the PlantCLEF task is supported by the French project Floris’Tic (Tela Botanica, INRIA, CIRAD, INRA, IRD) funded in the context of the national investment program PIA. The organization of the BirdCLEF task is supported by the Xeno-Canto foundation for nature sounds as well as the French CNRS project SABIOD.ORG and EADM MADICS, and Floris’Tic. The annotations of some soundscapes were prepared with the late wonderful Lucio Pando at Explorama Lodges, with the support of Pam Bucur, Marie Trone and H. Glotin. The organization of the SeaCLEF task is supported by the Ceta-mada NGO and the French project Floris’Tic.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Joly, A. et al. (2019). Biodiversity Information Retrieval Through Large Scale Content-Based Identification: A Long-Term Evaluation. In: Ferro, N., Peters, C. (eds) Information Retrieval Evaluation in a Changing World. The Information Retrieval Series, vol 41. Springer, Cham. https://doi.org/10.1007/978-3-030-22948-1_16
Download citation
DOI: https://doi.org/10.1007/978-3-030-22948-1_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-22947-4
Online ISBN: 978-3-030-22948-1
eBook Packages: Computer ScienceComputer Science (R0)