Multimodal BCI system for user's performance assessment

• Main Author: Nageshwari Rajadharen
• Other Authors: Zhong Wende
• Format: Final Year Project
• Language: English
• Published: 2018
• Subjects: DRNTU::Science
• Online Access: http://hdl.handle.net/10356/74453
• Institution: Nanyang Technological University

As technology advances, more learning materials for students are shifted to an online platform. Learning through online platform must be engaging enough for the students to stay focus and continue learning. Thus, it is crucial to evaluate the engagement level of the students. Multimodal Brain Computer Interface (BCI) system is developed to effectively assess the learning performance of the students. Two different experiments were conducted. For the 1st experiment, electroencephalogram (EEG), gaze positions and photoplethysmogram (PPG) of the students are recorded. For the 2nd experiment, gaze positions and EEG of the students are recorded. Features are extracted from each modality. Data analysis are conducted to analyse the features extracted in depth. Results have revealed that the eye-tracker used is of high accuracy and music does distract the students as their attention level tends to decrease. Not only that, it is also observed that the students showed negative feelings towards the end of the experiment. Using only one modality is not sufficient to assess the engagement level of the students, hence the multimodal system is able to assess visual and mental engagement more accurately. These will aid educators to better assess and understand students’ response towards the learning materials and their performance, enabling more effective intervention and meaningful improvements in learning materials.