E-invigilator using computer vision

• Main Author: Tan, Sharlene Shi Yan
• Other Authors: Jong Ching Chuen
• Format: Final Year Project
• Language: English
• Published: Nanyang Technological University 2021
• Subjects: Engineering::Electrical and electronic engineering
• Online Access: https://hdl.handle.net/10356/149982
• Institution: Nanyang Technological University

The application of machine learning (ML) techniques in object detection area has been improved drastically in the past decade. The improvements in artificial intelligence (AI) and research in deep learning (DL) and neural networks (NN) has enabled this sector to skyrocket in the late 2010. Object detection merges the task of object classification and localization. Current object detectors are mainly divided into 2 categories: 1. Networks which isolates the location of objects and their classification, such as Faster R-CNN. 2. Networks which predict bounding boxes and class scores simultaneously, such as You Only Look Once (YOLO) and Single Shot Detector (SSD) networks. There are unlimited competitive object detection models which are written annually. The AI that stood out with the greatest number of models designed is computer vision. Ever since mobile applications were introduced, it has garnered an exponential surge in popularity. Currently, almost 80% of people are online through mobile devices and more than 90% of Singapore’s population owns a smartphone. [1] With the advancement of smartphones and the increasing number of users, it houses so much potential to cater to the needs of different users.The proposed project mainly focuses on the search for the most optimal solution to perform custom object detection to facilitate virtual examination invigilation. A brief study on basic deep learning knowledge, especially the functionalities of various models in this area, are performed. The project conducts an analysis of the different state-of-the-art object detection models, and reasons for settling on using YOLOv4 to design a custom object detection. A mobile application is also developed on Android Studios to create a graphical user interface to perform real-time custom object detection. The application will demonstrate the basic features of E-invigilation such as custom object detection and submission of candidates’ information for authentication. The backend development for authentication is also implemented for examiners' use.