Detection of human-object interaction in the meeting room

• Main Author: Wang, Taige
• Other Authors: Tan Yap Peng
• Format: Final Year Project
• Language: English
• Published: Nanyang Technological University 2020
• Subjects: Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision; Engineering::Electrical and electronic engineering
• Online Access: https://hdl.handle.net/10356/139873
• Institution: Nanyang Technological University

With the improvement of computer capabilities and fast development of AI technology, our lives are gradually changing and improving, and more novel goals are being achieved. For example, face detection and recognition help the goal ‘Smart Workspace’ come true by using a simple, efficient and accurate method of checking in and out to replace the old method which has a lot of loopholes; Object detection and recognition help the goal ‘Smart Classroom’ come true by recording and recognizing students’ behavior in real time. Recently, the goal of ‘Smart Meeting room’ has been proposed to help people have a better record and analysis of the meeting. Some tasks need to be done like to know how human and human communicate, what people do during the meeting and how they interact with the surroundings. To better understand and record what people are doing and interacting with objects around, this project applies one of the latest research topics in computer vision – ‘Human-Object Interaction Detection’ into the scenario of a meeting room. In this project, one proper HOI detection method named ‘iCAN’ has been chosen among the state-of-art in this topic to be the baseline after some study. iCAN was trained and evaluated on the V-COCO and HICO-DET datasets. After a demo of iCAN on the example pictures of a meeting, some common problems were found. Then a small evaluation dataset about the meeting room was set up to evaluate the performance of iCAN in the scenario of meeting rooms. By taking the evaluation dataset as the standard, the original method has been modified to solve the common problems which occurs previously. At last, some automation work has been done to make the whole process quick and convenient.