Multi-stream spatiotemporal networks for driver fatigue detection from infrared and depth videos

This thesis presents new methods for incorporating multi-stream networks into the driver fatigue detection system. For the depth video-based method, a two-stream CNN architecture is proposed to incorporate spatial information of the current depth frame and temporal information of neighboring depth f...

وصف كامل

محفوظ في:
التفاصيل البيبلوغرافية
المؤلف الرئيسي: Ma, Xiaoxi
مؤلفون آخرون: Yap Kim Hui
التنسيق: Thesis-Doctor of Philosophy
اللغة:English
منشور في: Nanyang Technological University 2023
الموضوعات:
الوصول للمادة أونلاين:https://hdl.handle.net/10356/164796
الوسوم: إضافة وسم
لا توجد وسوم, كن أول من يضع وسما على هذه التسجيلة!
الوصف
الملخص:This thesis presents new methods for incorporating multi-stream networks into the driver fatigue detection system. For the depth video-based method, a two-stream CNN architecture is proposed to incorporate spatial information of the current depth frame and temporal information of neighboring depth frames which is represented by motion vectors. For the infrared video-based method, a convolutional three-stream network is proposed to incorporate current-infrared-frame-based spatial information, optical-flow-based short-term temporal information of two consecutive infrared frames, and optical flow-motion history image-based temporal information within the infrared video sequence.