Benchmark datasets for detection and identification of insects from camera trap images with deep learning

Insect benchmark datasets for training, validation and test (train1201.zip, val1201.zip and test1201.zip) with time-lapse images as described in paper: Bjerge K, Alison J, Dyrmann M, Frigaard C.E., Mann H. M. R., Høye T.T., Accurate detection and identification of insects from camera trap images with deep learning, bioRxiv:10.1101/2022.10.25.513484v1 Labels in YOLO format: ultralytics/yolov5: label format The annotated training and validation datasets contains insects of nine different species as listed below: 0 Coccinellidae septempunctata 1 Apis mellifera 2 Bombus lapidarius 3 Bombus terrestris 4 Eupeodes corolla 5 Episyrphus balteatus 6 Aglais urticae 7 Vespula vulgaris 8 Eristalis tenax The test dataset contains additional classes of insects. 9 Non-Bombus Anthophila 10 Bombus spp. 11 Syrphidae 12 Fly spp. 13 Unclear insect 14 Mixed animals: —————————— Rhopalocera Non-Anthophila Hymenoptera Non-Syrphidae Diptera Non-Conccinalidae Coleoptera Concinellidae Other animals There are two naming conventions for image (.jpg) and label (.txt) files. Background images without insects are named: “X_Seq-YYYYMMDDHHMMSS-snapshot”. E.g.: Background image: 12_13-20190704172200-snapshot.jpg Empty label file: 12_13-20190704172200-snapshot.txt Images annotated with insects are named: “SZ_IP-MonthDate_C_Seq-YYYYMMDDHHMMSS”. E.g.: Image file: S1_146-Aug23_1_156-20190822133230.jpg Label file: S1_146-Aug23_1_156-20190822133230.txt Abbreviations: YYYYMMDDHHMMSS – Capture timestamp with year, month, date, hour, minutes, and second Seq – Sequence number created by the motion program to separate images C – Identification of two cameras with Id=0 or Id=1 in system identified by SZ_IP MonthDate – Folder name for where the original image were stored in the system SZ_IP – Identification of five camera systems: S1_123, S2_146, S3_194, S4_199, S5_187 (Two cameras in each system) X – An index number related to a specific camera and folder ensuring unique file names of background images from different camera systems. The important information in a filename is system (SZ_IP), camera Id (C) and timestamp (YYYYMMDDHHMMSS). The three best YOLOv5 models (YOLOv5models.zip) from the paper are available in pytorch format. All models are tested with YOLOv5 release v7.0 (22-11-2022): ultralytics/yolov5: YOLOv5  in PyTorch insect1201-bestF1-640v5m.pt: Model no. 6 in Table 2 (F1=0.912) insect1201-bestF1-1280v5m6.pt: Model no. 8 in Table 2 (F1=0.925) insect1201-bestF1-1280v5m6.pt: Model no. 10 in Table 2 (F1=0.932) insects-1201val.yaml: YAML file with label names to train YOLOv5 trainInsects-1201m.sh: Linux bash shell script with parameters to train YOLOv5m6 valInsectsF1-1201.sh: Linux bash shell script with parameters to validated models