Chelonia mydas detection and image extraction from field recordings

• Main Authors: Khalif Amir, Zakry, Mohamad Syahiran, Soria, Irwandi, Hipiny, Hamimah, Ujir, Ruhana, Hassan, Richki, Hardi
• Format: Article
• Language: English
• Published: IAES 2024
• Subjects: QA75 Electronic computers. Computer science
• Online Access: http://ir.unimas.my/id/eprint/44565/3/Chelonia.pdf; http://ir.unimas.my/id/eprint/44565/; https://ijai.iaescore.com/index.php/IJAI/article/view/23748; http://doi.org/10.11591/ijai.v13.i2.pp2354-2363
• Institution: Universiti Malaysia Sarawak

Wildlife videography is an essential data collection method for conducting. The video recording process of an animal like the Chelonia mydas sea turtles in its habitat requires setting up special camera or by performing complex camera movement whilst the camera operator maneuvers over its complicated habitat. The result is hours of footage that contains only some good data that can be used for further animal research but still requires human input in filtering it out This presents a problem that artificial intelligence models can assist, especially to automate extracting any good data. This paper proposes usage of machine learning models to crop images of endangered Chelonia mydas turtles to help prune through hundreds and thousands of frames from several video footages. By human supervision, we extracted and curated a dataset of 1,426 good data from our video dataset and used it to perform transfer learning on a you only look once (YOLO)v7 pre-trained model. Our paper shows that the retrained YOLOv7 model when run through our remaining video dataset with various confidence scores can crop images in the field video recordings of Chelonia mydas turtles with up to 99.89% of output correctly cropped thus automating the data extraction process.