Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
97 tokens/sec
GPT-4o
11 tokens/sec
Gemini 2.5 Pro Pro
47 tokens/sec
o3 Pro
5 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

WildlifeDatasets: An open-source toolkit for animal re-identification (2311.09118v2)

Published 15 Nov 2023 in cs.CV

Abstract: In this paper, we present WildlifeDatasets (https://github.com/WildlifeDatasets/wildlife-datasets) - an open-source toolkit intended primarily for ecologists and computer-vision / machine-learning researchers. The WildlifeDatasets is written in Python, allows straightforward access to publicly available wildlife datasets, and provides a wide variety of methods for dataset pre-processing, performance analysis, and model fine-tuning. We showcase the toolkit in various scenarios and baseline experiments, including, to the best of our knowledge, the most comprehensive experimental comparison of datasets and methods for wildlife re-identification, including both local descriptors and deep learning approaches. Furthermore, we provide the first-ever foundation model for individual re-identification within a wide range of species - MegaDescriptor - that provides state-of-the-art performance on animal re-identification datasets and outperforms other pre-trained models such as CLIP and DINOv2 by a significant margin. To make the model available to the general public and to allow easy integration with any existing wildlife monitoring applications, we provide multiple MegaDescriptor flavors (i.e., Small, Medium, and Large) through the HuggingFace hub (https://huggingface.co/BVRA).

Definition Search Book Streamline Icon: https://streamlinehq.com
References (57)
  1. Right whale recognition, 2015.
  2. Humpback whale identification, 2019.
  3. Beluga ID 2022, 2022.
  4. Turtle recall: Conservation challenge, 2022.
  5. SeaTurtleID2022: A long-span dataset for reliable sea turtle re-identification. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2024.
  6. Computer-aided photo-identification system with an application to polar bears based on whisker spot patterns. Journal of Mammalogy, 91(6):1350–1359, 2010.
  7. Visual identification of individual holstein-friesian cattle via deep metric learning. Computers and Electronics in Agriculture, 185:106133, 2021.
  8. Visual localisation and individual identification of holstein friesian cattle via deep learning. In Proceedings of the IEEE International Conference on Computer Vision Workshops, pages 2850–2859, 2017.
  9. Automatic individual holstein friesian cattle identification via selective local coat pattern matching in RGB-D imagery. In 2016 IEEE International Conference on Image Processing (ICIP), pages 484–488. IEEE, 2016.
  10. System for elephant ear-pattern knowledge (seek) to identify individual african elephants. Pachyderm, 61:63–77, 2020.
  11. A computer-assisted system for photographic mark–recapture analysis. Methods in Ecology and Evolution, 3(5):813–822, 2012.
  12. Re-identification of zebrafish using metric learning. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision Workshops, pages 1–11, 2020.
  13. Advanced image recognition: a fully automated, high-accuracy photo-identification matching system for humpback whales. Mammalian Biology, 102(3):915–929, 2022.
  14. Beyond triplet loss: a deep quadruplet network for person re-identification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 403–412, 2017.
  15. Hotspotter-patterned species instance recognition. In 2013 IEEE Workshop on Applications of Computer Vision (WACV), pages 230–237. IEEE, 2013.
  16. Face recognition: Primates in the wild. In 2018 IEEE 9th International Conference on Biometrics Theory, Applications and Systems (BTAS), pages 1–10. IEEE, 2018.
  17. Arcface: Additive angular margin loss for deep face recognition. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 4690–4699, 2019.
  18. Nkosikhona Dlamini and Terence L van Zyl. Automated identification of individuals in wildlife population using siamese neural networks. In 2020 7th International Conference on Soft Computing & Machine Intelligence (ISCMI), pages 224–228. IEEE, 2020.
  19. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929, 2020.
  20. Genetic fingerprinting proves cross-correlated automatic photo-identification of individuals as highly efficient in large capture–mark–recapture studies. Ecology and Evolution, 5(1):141–151, 2015.
  21. Hotspotter: Using a computer-driven photo-id application to identify sea turtles. Journal of Experimental Marine Biology and Ecology, 535:151490, 2021.
  22. Deep learning-based methods for individual recognition in small birds. Methods in Ecology and Evolution, 11(9):1072–1085, 2020.
  23. Chimpanzee faces in the wild: Log-Euclidean CNNs for predicting identities and attributes of primates. In German Conference on Pattern Recognition, pages 51–63. Springer, 2016.
  24. Towards self-supervision for video identification of individual holstein-friesian cattle: The Cows2021 dataset. arXiv preprint arXiv:2105.01938, 2021.
  25. Computer-assisted recognition of dolphin individuals using dorsal fin pigmentations. In 2016 International Conference on Image and Vision Computing New Zealand (IVCNZ), pages 1–6. IEEE, 2016.
  26. In defense of the triplet loss for person re-identification. arXiv preprint arXiv:1703.07737, 2017.
  27. Estimating population size, structure, and residency time for whale sharks Rhincodon typus through collaborative photo-identification. Endangered Species Research, 7(1):39–53, 2009.
  28. Billion-scale similarity search with GPUs. IEEE Transactions on Big Data, 7(3):535–547, 2019.
  29. Marcella J Kelly. Computer-aided photograph matching in studies using individual identification: an example from Serengeti cheetahs. Journal of Mammalogy, 82(2):440–449, 2001.
  30. Biometric animal databases from field photographs: identification of individual zebra in the wild. In Proceedings of the 1st ACM International Conference on Multimedia Retrieval, pages 1–8, 2011.
  31. ATRW: A benchmark for amur tiger re-identification in the wild. arXiv preprint arXiv:1906.05586, 2019.
  32. Swin transformer: Hierarchical vision transformer using shifted windows. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 10012–10022, 2021.
  33. A convnet for the 2020s. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 11976–11986, 2022.
  34. Revisiting animal photo-identification using deep metric learning and network analysis. Methods in Ecology and Evolution, 12(5):863–873, 2021.
  35. A metric learning reality check. In Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XXV 16, pages 681–699. Springer, 2020.
  36. SealID: Saimaa ringed seal re-identification dataset. arXiv preprint arXiv:2206.02260, 2022.
  37. Dinov2: Learning robust visual features without supervision. arXiv preprint arXiv:2304.07193, 2023.
  38. SeaTurtleID: A novel long-span dataset highlighting the importance of timestamps in wildlife re-identification. arXiv preprint arXiv:2211.10307, 2022.
  39. Social media reveals consistently disproportionate tourism pressure on a threatened marine vertebrate. Animal Conservation, 24(4):568–579, 2021.
  40. Animal population censusing at scale with citizen science and photographic identification. In 2017 AAAI Spring Symposium Series, 2017.
  41. Re-identification of giant sunfish using keypoint matching. In Proceedings of the Northern Lights Deep Learning Workshop, volume 3, 2022.
  42. Learning transferable visual models from natural language supervision. In International Conference on Machine Learning, pages 8748–8763. PMLR, 2021.
  43. A SIFT-based software system for the photo-identification of the Risso’s dolphin. Ecological informatics, 50:95–101, 2019.
  44. Can Drosophila melanogaster tell who’s who? PloS one, 13(10):e0205043, 2018.
  45. More aggressive sea turtles win fights over foraging resources independent of body size and years of presence. Animal Behaviour, 190:209–219, 2022.
  46. Facenet: A unified embedding for face recognition and clustering. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 815–823, 2015.
  47. NDD20: A large-scale few-shot dolphin dataset for coarse and fine-grained categorisation. arXiv preprint arXiv:2005.13359, 2020.
  48. Botswana Predator Conservation Trust. Panthera pardus csv custom export, 2022.
  49. Automatic individual recognition of Japanese macaques (Macaca fuscata) from sequential images. Ethology, 128(5):461–470, 2022.
  50. Perspectives on individual animal identification from biology and computer vision. Integrative and Comparative Biology, 61(3):900–916, 2021.
  51. Giant panda identification. IEEE Transactions on Image Processing, 30:2837–2849, 2021.
  52. Extracting identifying contours for African elephants and humpback whales using a learned appearance model. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 1276–1285, 2020.
  53. Ross Wightman. Pytorch image models. https://github.com/rwightman/pytorch-image-models, 2019.
  54. Claire L Witham. Automated face recognition of rhesus macaques. Journal of Neuroscience Methods, 300:157–165, 2018.
  55. Aggregated residual transformations for deep neural networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1492–1500, Honolulu, 2017.
  56. Beyond triplet loss: person re-identification with fine-grained difference-aware pairwise loss. IEEE Transactions on Multimedia, 24:1665–1677, 2021.
  57. Three-D safari: Learning to estimate zebra pose, shape, and texture from images ”In the wild”. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 5359–5368, 2019.
Citations (10)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now