Automatic discard registration in cluttered environments using deep learning and object tracking: class imbalance, occlusion, and a comparison to human review

Rick van Essen, Angelo Mencarelli, Aloysius Van helmond, Linh Nguyen, Jurgen Batsleer, Jan-Jaap Poos, Gert Kootstra*

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

9 Citations (Scopus)

Abstract

This paper presents and evaluates a method for detecting and counting demersal fish species in complex, cluttered, and occluded environments that can be installed on the conveyor belts of fishing vessels. Fishes on the conveyor belt were recorded using a colour camera and were detected using a deep neural network. To improve the detection, synthetic data were generated for rare fish species. The fishes were tracked over the consecutive images using a multi-object tracking algorithm, and based on multiple observations, the fish species was determined. The effect of the synthetic data, the amount of occlusion, and the observed dorsal or ventral fish side were investigated and a comparison with human electronic monitoring (EM) review was made. Using the presented method, a weighted counting error of 20% was achieved, compared to a counting error of 7% for human EM review on the same recordings.
Original languageEnglish
Pages (from-to)3834–3846
JournalICES Journal of Marine Science
Volume78
Issue number10
DOIs
Publication statusPublished - 27 Nov 2021

Keywords

  • by-catch registration
  • computer vision
  • deep learning
  • electronic monitoring
  • object detection
  • object tracking

Fingerprint

Dive into the research topics of 'Automatic discard registration in cluttered environments using deep learning and object tracking: class imbalance, occlusion, and a comparison to human review'. Together they form a unique fingerprint.

Cite this