Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
149 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Deep Active Learning with Noisy Oracle in Object Detection (2310.00372v1)

Published 30 Sep 2023 in cs.CV and cs.LG

Abstract: Obtaining annotations for complex computer vision tasks such as object detection is an expensive and time-intense endeavor involving a large number of human workers or expert opinions. Reducing the amount of annotations required while maintaining algorithm performance is, therefore, desirable for machine learning practitioners and has been successfully achieved by active learning algorithms. However, it is not merely the amount of annotations which influences model performance but also the annotation quality. In practice, the oracles that are queried for new annotations frequently contain significant amounts of noise. Therefore, cleansing procedures are oftentimes necessary to review and correct given labels. This process is subject to the same budget as the initial annotation itself since it requires human workers or even domain experts. Here, we propose a composite active learning framework including a label review module for deep object detection. We show that utilizing part of the annotation budget to correct the noisy annotations partially in the active dataset leads to early improvements in model performance, especially when coupled with uncertainty-based query strategies. The precision of the label error proposals has a significant influence on the measured effect of the label review. In our experiments we achieve improvements of up to 4.5 mAP points of object detection performance by incorporating label reviews at equal annotation budget.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (27)
  1. Active learning for deep object detection. arXiv preprint arXiv:1809.09875, 2018.
  2. End-to-end object detection with transformers. In European conference on computer vision, pages 213–229. Springer, 2020.
  3. MMDetection: Open mmlab detection toolbox and benchmark. arXiv preprint arXiv:1906.07155, 2019.
  4. Active Learning for Deep Object Detection via Probabilistic Modeling. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 10244–10253, Montreal, QC, Canada, October 2021. IEEE.
  5. Emnist: Extending mnist to handwritten letters. In 2017 international joint conference on neural networks (IJCNN), pages 2921–2926. IEEE, 2017.
  6. The pascal visual object classes (voc) challenge. International journal of computer vision, 88:303–338, 2010.
  7. Noisy Batch Active Learning with Deterministic Annealing. arXiv preprint arXiv:1909.12473, 2019.
  8. Scalable Active Learning for Object Detection. In 2020 IEEE Intelligent Vehicles Symposium (IV), pages 1430–1435, October 2020.
  9. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 770–778, 2016.
  10. Probability differential-based class label noise purification for object detection in aerial images. IEEE Geoscience and Remote Sensing Letters, 19:1–5, 2022.
  11. Kwang In Kim. Active Label Correction Using Robust Parameter Update and Entropy Propagation. In European Conference on Computer Vision, pages 1–16. Springer, 2022.
  12. Effect of annotation errors on drone detection with YOLOv3. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pages 1030–1031, 2020.
  13. Focal loss for dense object detection. In Proceedings of the IEEE international conference on computer vision, pages 2980–2988, 2017.
  14. Microsoft coco: Common objects in context. In Computer Vision–ECCV 2014: 13th European Conference, Zurich, Switzerland, September 6-12, 2014, Proceedings, Part V 13, pages 740–755. Springer, 2014.
  15. Yolov3: An incremental improvement. arXiv preprint arXiv:1804.02767, 2018.
  16. Faster r-cnn: Towards real-time object detection with region proposal networks. Advances in neural information processing systems, 28, 2015.
  17. Towards rapid prototyping and comparability in active learning for deep object detection, 2022.
  18. Deep active learning for object detection. In BMVC, volume 362, page 91, 2018.
  19. Automated Annotator Variability Inspection for Biomedical Image Segmentation. IEEE access, 10:2753, 2022.
  20. Advanced active learning strategies for object detection. In 2020 IEEE Intelligent Vehicles Symposium (IV), pages 871–876. IEEE, 2020.
  21. Identifying label errors in object detection datasets by loss inspection. arXiv preprint arXiv:2303.06999, 2023.
  22. Burr Settles. Active learning literature survey. 2009.
  23. Active learning from imperfect labelers. Advances in Neural Information Processing Systems, 29, 2016.
  24. Learning from multiple annotators with varying expertise. Machine Learning, 95(3):291–327, June 2014.
  25. Active learning for noisy data streams using weak and strong labelers. arXiv preprint arXiv:2010.14149, 2020.
  26. Qactor: Active learning on noisy labels. In Asian Conference on Machine Learning, pages 548–563. PMLR, 2021.
  27. Bdd100k: A diverse driving dataset for heterogeneous multitask learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 2636–2645, 2020.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now