A compact and interpretable convolutional neural network for cross-subject driver drowsiness detection from single-channel EEG

Driver drowsiness is one of the main factors leading to road fatalities and hazards in the transportation industry. Electroencephalography (EEG) has been considered as one of the best physiological signals to detect drivers' drowsy states, since it directly measures neurophysiological activitie...

Full description

Saved in:
Bibliographic Details
Main Authors: Cui, Jian, Lan, Zirui, Liu, Yisi, Li, Ruilin, Li, Fan, Sourina, Olga, Müller-Wittig, Wolfgang
Other Authors: Fraunhofer Singapore
Format: Article
Language:English
Published: 2022
Subjects:
Online Access:https://hdl.handle.net/10356/156070
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-156070
record_format dspace
spelling sg-ntu-dr.10356-1560702022-04-09T20:11:09Z A compact and interpretable convolutional neural network for cross-subject driver drowsiness detection from single-channel EEG Cui, Jian Lan, Zirui Liu, Yisi Li, Ruilin Li, Fan Sourina, Olga Müller-Wittig, Wolfgang Fraunhofer Singapore Science::Biological sciences::Human anatomy and physiology Engineering::Computer science and engineering Single-Channel EEG Driver Drowsiness Detection Convolutional Neural Network Driver drowsiness is one of the main factors leading to road fatalities and hazards in the transportation industry. Electroencephalography (EEG) has been considered as one of the best physiological signals to detect drivers' drowsy states, since it directly measures neurophysiological activities in the brain. However, designing a calibration-free system for driver drowsiness detection with EEG is still a challenging task, as EEG suffers from serious mental and physical drifts across different subjects. In this paper, we propose a compact and interpretable Convolutional Neural Network (CNN) to discover shared EEG features across different subjects for driver drowsiness detection. We incorporate the Global Average Pooling (GAP) layer in the model structure, allowing the Class Activation Map (CAM) method to be used for localizing regions of the input signal that contribute most for classification. Results show that the proposed model can achieve an average accuracy of 73.22% on 11 subjects for 2-class cross-subject EEG signal classification, which is higher than conventional machine learning methods and other state-of-art deep learning methods. It is revealed by the visualization technique that the model has learned biologically explainable features, e.g., Alpha spindles and Theta burst, as evidence for the drowsy state. It is also interesting to see that the model uses artifacts that usually dominate the wakeful EEG, e.g., muscle artifacts and sensor drifts, to recognize the alert state. The proposed model illustrates a potential direction to use CNN models as a powerful tool to discover shared features related to different mental states across different subjects from EEG signals. National Research Foundation (NRF) Submitted/Accepted version This research is supported by the National Research Foundation, Singapore under its International Research Centres in Singapore Funding Initiative. 2022-04-04T08:12:34Z 2022-04-04T08:12:34Z 2021 Journal Article Cui, J., Lan, Z., Liu, Y., Li, R., Li, F., Sourina, O. & Müller-Wittig, W. (2021). A compact and interpretable convolutional neural network for cross-subject driver drowsiness detection from single-channel EEG. Methods. https://dx.doi.org/10.1016/j.ymeth.2021.04.017 1046-2023 https://hdl.handle.net/10356/156070 10.1016/j.ymeth.2021.04.017 33901644 2-s2.0-85105038589 en Methods © 2021 Elsevier Inc. All rights reserved. This paper was published in Methods is made available with permission of Elsevier Inc. application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Science::Biological sciences::Human anatomy and physiology
Engineering::Computer science and engineering
Single-Channel EEG
Driver Drowsiness Detection
Convolutional Neural Network
spellingShingle Science::Biological sciences::Human anatomy and physiology
Engineering::Computer science and engineering
Single-Channel EEG
Driver Drowsiness Detection
Convolutional Neural Network
Cui, Jian
Lan, Zirui
Liu, Yisi
Li, Ruilin
Li, Fan
Sourina, Olga
Müller-Wittig, Wolfgang
A compact and interpretable convolutional neural network for cross-subject driver drowsiness detection from single-channel EEG
description Driver drowsiness is one of the main factors leading to road fatalities and hazards in the transportation industry. Electroencephalography (EEG) has been considered as one of the best physiological signals to detect drivers' drowsy states, since it directly measures neurophysiological activities in the brain. However, designing a calibration-free system for driver drowsiness detection with EEG is still a challenging task, as EEG suffers from serious mental and physical drifts across different subjects. In this paper, we propose a compact and interpretable Convolutional Neural Network (CNN) to discover shared EEG features across different subjects for driver drowsiness detection. We incorporate the Global Average Pooling (GAP) layer in the model structure, allowing the Class Activation Map (CAM) method to be used for localizing regions of the input signal that contribute most for classification. Results show that the proposed model can achieve an average accuracy of 73.22% on 11 subjects for 2-class cross-subject EEG signal classification, which is higher than conventional machine learning methods and other state-of-art deep learning methods. It is revealed by the visualization technique that the model has learned biologically explainable features, e.g., Alpha spindles and Theta burst, as evidence for the drowsy state. It is also interesting to see that the model uses artifacts that usually dominate the wakeful EEG, e.g., muscle artifacts and sensor drifts, to recognize the alert state. The proposed model illustrates a potential direction to use CNN models as a powerful tool to discover shared features related to different mental states across different subjects from EEG signals.
author2 Fraunhofer Singapore
author_facet Fraunhofer Singapore
Cui, Jian
Lan, Zirui
Liu, Yisi
Li, Ruilin
Li, Fan
Sourina, Olga
Müller-Wittig, Wolfgang
format Article
author Cui, Jian
Lan, Zirui
Liu, Yisi
Li, Ruilin
Li, Fan
Sourina, Olga
Müller-Wittig, Wolfgang
author_sort Cui, Jian
title A compact and interpretable convolutional neural network for cross-subject driver drowsiness detection from single-channel EEG
title_short A compact and interpretable convolutional neural network for cross-subject driver drowsiness detection from single-channel EEG
title_full A compact and interpretable convolutional neural network for cross-subject driver drowsiness detection from single-channel EEG
title_fullStr A compact and interpretable convolutional neural network for cross-subject driver drowsiness detection from single-channel EEG
title_full_unstemmed A compact and interpretable convolutional neural network for cross-subject driver drowsiness detection from single-channel EEG
title_sort compact and interpretable convolutional neural network for cross-subject driver drowsiness detection from single-channel eeg
publishDate 2022
url https://hdl.handle.net/10356/156070
_version_ 1731235698680266752