Detecting Driver Drowsiness Based on Sensors: A Review

Detecting Driver Drowsiness Based on Sensors: A Review Arun Sahayadhas AI-Rehab Research Group, Universiti Malaysia Perlis (UniMAP), Kampus Pauh Putra, 02600 Arau, Perlis, Malaysia Kenneth Sundaraj AI-Rehab Research Group, Universiti Malaysia Perlis (UniMAP), Kampus Pauh Putra, 02600 Arau, Perlis, Malaysia Murugappan Murugappan AI-Rehab Research Group, Universiti Malaysia Perlis (UniMAP), Kampus Pauh Putra, 02600 Arau, Perlis, Malaysia

In recent years, driver drowsiness has been one of the major causes of road accidents and can lead to severe physical injuries, deaths and significant economic losses. Statistics indicate the need of a reliable driver drowsiness detection system which could alert the driver before a mishap happens. Researchers have attempted to determine driver drowsiness using the following measures: (1) vehicle-based measures; (2) behavioral measures and (3) physiological measures. A detailed review on these measures will provide insight on the present systems, issues associated with them and the enhancements that need to be done to make a robust system. In this paper, we review these three measures as to the sensors used and discuss the advantages and limitations of each. The various ways through which drowsiness has been experimentally manipulated is also discussed. We conclude that by designing a hybrid drowsiness detection system that combines non-intusive physiological measures with other measures one would accurately determine the drowsiness level of a driver. A number of road accidents might then be avoided if an alert is sent to a driver that is deemed drowsy.
12 07 2012 16937 16953 s121216937 10.3390/mdpi_crossmark_policy www.mdpi.com true https://creativecommons.org/licenses/by/3.0/ 10.3390/s121216937 https://www.mdpi.com/1424-8220/12/12/16937 https://www.mdpi.com/1424-8220/12/12/16937/pdf (2009). Global Status Report on Road Safety 2009, World Health Organisation (WHO). Rau, P. (2005). Drowsy Driver Detection and Warning System for Commercial Vehicle Drivers: Field Operational Test Design, Analysis, and Progress, National Highway Traffic Safety Administration. (2010). Drivers Beware Getting Enough Sleep Can Save Your Life This Memorial Day, National Sleep Foundation (NSF). Husar, P. Eyetracker Warns against Momentary Driver Drowsiness. Available online: http://www.fraunhofer.de/en/press/research-news/2010/10/eye-tracker-driver-drowsiness.html (accessed on 27 July 2012). Liu Predicting driver drowsiness using vehicle measures: Recent insights and future challenges J. Saf. Res 2009 10.1016/j.jsr.2009.04.005 40 239 10.1016/j.aap.2012.05.005 Forsman, P.M., Vila, B.J., Short, R.A., Mott, C.G., and van Dongen, H.P.A. (2012). Efficient driver drowsiness detection at moderate levels of drowsiness. Accid. Anal. Prevent., in press. Xiao Yawning detection based on gabor wavelets and LDA J. Beijing Univ. Technol 2009 35 409 Zhang A new real-time eye tracking based on nonlinear unscented Kalman filter for monitoring driver fatigue J. Contr. Theor. Appl 2010 10.1007/s11768-010-8043-0 8 181 Yin Multiscale dynamic features based driver fatigue detection Int. J. Pattern Recogn. Artif. Intell 2009 10.1142/S021800140900720X 23 575 Akin Estimating vigilance level by using EEG and EMG signals Neural Comput. Appl 2008 10.1007/s00521-007-0117-7 17 227 10.1109/CIC.2008.4749205 Kokonozi, A.K., Michail, E.M., Chouvarda, I.C., and Maglaveras, N.M. (2008, January 14–17). A Study of Heart Rate and Brain System Complexity and Their Interaction in Sleep-Deprived Subjects. Bologna, Italy. Khushaba Driver drowsiness classification using fuzzy wavelet-packet-based feature-extraction algorithm IEEE Trans. Biomed. Eng 2011 10.1109/TBME.2010.2077291 58 121 Liang Changes in physiological parameters induced by indoor simulated driving: Effect of lower body exercise at mid-term break Sensors 2009 10.3390/s90906913 9 6913 Guosheng A driver fatigue recognition model based on information fusion and dynamic Bayesian network Inform. Sci 2010 10.1016/j.ins.2010.01.011 180 1942 Philip Fatigue, sleep restriction and driving performance Accid. Anal. Prevent 2005 10.1016/j.aap.2004.07.007 37 473 Tremaine The relationship between subjective and objective sleepiness and performance during a simulated night-shift with a nap countermeasure Appl. Ergon 2010 10.1016/j.apergo.2010.04.005 42 52 Brodbeck EEG microstates of wakefulness and NREM sleep NeuroImage 2012 10.1016/j.neuroimage.2012.05.060 62 2129 (1998). Drowsy Driving and Automobile Crashes, National Center on Sleep Disorder Research and the National Highway Traffic Safety Administration. Rosey Impact of narrower lane width: Comparison between fixed-base simulator and real data Transport. Res. Rec. J. Transport. Res. Board 2009 10.3141/2138-15 2138 112 Konstantopoulos Driver’s visual attention as a function of driving experience and visibility. Using a driving simulator to explore drivers’ eye movements in day, night and rain driving Accid. Anal. Prevent 2010 10.1016/j.aap.2009.09.022 42 827 Kaptein Driving simulator validity: Some considerations Transport. Res. Rec. J. Transport. Res. Board 1996 10.1177/0361198196155000105 1550 30 10.1016/j.aap.2012.04.015 Bella, F. (2012). Driver perception of roadside configurations on two-lane rural roads: Effects on speed and lateral placement. Accid. Anal. Prevent., in press. Auberlet The impact of perceptual treatments on driver’s behavior: From driving simulator studies to field tests—First results Accid. Anal. Prevent 2012 10.1016/j.aap.2011.11.020 45 91 Johnson Physiological responses to simulated and on-road driving Int. J. Psychophysiol 2011 10.1016/j.ijpsycho.2011.06.012 81 203 Mayhew On-road and simulated driving: Concurrent and discriminant validation J. Safety Res 2011 10.1016/j.jsr.2011.06.004 42 267 Ingre Subjective sleepiness, simulated driving performance and blink duration: Examining individual differences J. Sleep Res 2006 10.1111/j.1365-2869.2006.00504.x 15 47 Vitaterna Overview of circadian rhythms Alcohol Res. Health 2001 25 85 Hu Driver drowsiness detection with eyelid related parameters by support vector machine Exp. Syst. Appl 2009 10.1016/j.eswa.2008.09.030 36 7651 Peters Effects of partial and total sleep deprivation on driving performance Publ. Road 1999 62 2 Lal A critical review of the psychophysiology of driver fatigue Biol. Psychol 2001 10.1016/S0301-0511(00)00085-5 55 173 Horne Vehicle accidents related to sleep: A review Occup. Environ. Med 1999 10.1136/oem.56.5.289 56 289 Otmani Effect of driving duration and partial sleep deprivation on subsequent alertness and performance of car drivers Physiol. Behav 2005 10.1016/j.physbeh.2005.02.021 84 715 Thiffault Monotony of road environment and driver fatigue: A simulator study Accid. Anal. Prevent 2003 10.1016/S0001-4575(02)00014-3 35 381 Portouli On-road experiment for collecting driving behavioural data of sleepy drivers Somnology 2007 10.1007/s11818-007-0319-3 11 259 Sommer Biosignal based discrimination between slight and strong driver hypovigilance by support-vector machines Agents and Artificial Intelligence 2010 10.1007/978-3-642-11819-7_14 67 177 Fairclough Impairment of driving performance caused by sleep deprivation or alcohol: A comparative study J. Hum. Factors Ergon 1999 10.1518/001872099779577336 41 118 Ruijia, F., Guangyuan, Z., and Bo, C. (2009, January 26–29). An on-Board System for Detecting Driver Drowsiness Based on Multi-Sensor Data Fusion Using Dempster-Shafer Theory. Okayama, Japan. Vural, E. (2009). Video Based Detection of Driver Fatigue. Ph.D. Thesis,. Simons Effects of dexamphetamine with and without alcohol on simulated driving Psychopharmacology 2012 10.1007/s00213-011-2549-0 222 391 Das Differentiating alcohol-induced driving behavior using steering wheel signals IEEE Trans. Intell. Transport. Syst 2012 10.1109/TITS.2012.2188891 13 1355 Mets Effects of alcohol on highway driving in the STISIM driving simulator Hum. Psychopharm 2011 10.1002/hup.1226 26 434 Lew Drowsy driver detection through facial movement analysis Human-Computer Interaction 2007 4796 6 Bergasa Real-time system for monitoring driver vigilance IEEE Trans. Intell. Transport. Syst 2006 10.1109/TITS.2006.869598 7 63 Leo A visual approach for driver inattention detection Pattern Recog 2007 10.1016/j.patcog.2007.01.018 40 2341 Dang, H.L., Peng, S., Yan, Q.X., and Yun, X.Y. (2010, January 12–13). Drowsiness Detection Based on Eyelid Movement. Wuhan, China. Dinges, D.F., Mallis, M.M., Maislin, G., and Powell, J.W. (1998). Final Report: Evaluation of Techniques for Ocular Measurement as an Index of Fatigue and as the Basis for Alertness Management, Report for NHTSA. Abe Detecting deteriorated vigilance using percentage of eyelid closure time during behavioral maintenance of wakefulness tests Int. J. Psychophysiol 2011 10.1016/j.ijpsycho.2011.09.012 82 269 McKinley Evaluation of eye metrics as a detector of fatigue Hum. Factors 2011 10.1177/0018720811411297 53 403 Seeingmachines Driver State Sensor. Available online: http://www.seeingmachines.com/product/dss/ (accessed on 21 November 2012). Lexus, L.X. Driver Monitoring System. Available online: http://www.lexus.eu/range/ls/key-features/safety/safety-driver-monitoring-system.aspx (accessed on 21 November 2012). Smith Determining driver visual attention with one camera IEEE Trans. Intell. Transport. Syst 2003 10.1109/TITS.2003.821342 4 205 Trivedi Head pose estimation and augmented reality tracking: An integrated system and evaluation for monitoring driver awareness IEEE Trans. Intell. Transp. Syst 2010 10.1109/TITS.2010.2044241 11 300 Xue, T.Z., Nan, N.Z., Fan, M., and Yong, J.H. (2009, January 3–5). Head Pose Estimation Using Isophote Features for Driver Assistance Systems. Xi’an, China. Hartley, L., Horberry, T., Mabbott, N., and Krueger, G. (2000). Review of Fatigue Detection and Prediction Technologies, National Road Transport Commission. Shen Effective driver fatigue monitoring through pupil detection and yawing analysis in low light level environments Int. J. Digit. Technol. Appl 2012 6 372 Flores Driver drowsiness warning system using visual information for both diurnal and nocturnal illumination conditions EURASIP J. Adv. Signal Process 2010 10.1155/2010/438205 2010 438205 Golz Evaluation of fatigue monitoring technologies Somnology 2010 10.1007/s11818-010-0482-9 14 187 Patel Applying neural network analysis on heart rate variability data to assess driver fatigue Exp. Syst. Appl 2011 10.1016/j.eswa.2010.12.028 38 7235 Fu Generalized EEG-based drowsiness prediction system by using a self-organizing neural fuzzy system IEEE Trans. Circ. Syst 2012 59 2044 Chin A real-time wireless brain-computer interface system for drowsiness detection IEEE Trans. Biomed. Circ. Syst 2010 10.1109/TBCAS.2010.2046415 4 214 Kurt The ANN-based computing of drowsy level Exp. Syst. Appl 2009 10.1016/j.eswa.2008.01.085 36 2534 Liu EEG-based estimation of mental fatigue by using KPCA-HMM and complexity parameters Biomed. Signal Process. Contr 2010 10.1016/j.bspc.2010.01.001 5 124 10.1109/ITSC.2009.5309881 Miyaji, M., Kawanaka, H., and Oguri, K. (2009, January 3–7). Driver’s Cognitive Distraction Detection Using Physiological Features by the Adaboost. St. Louis, MO, USA. 10.1109/IEMBS.2008.4649724 Michail, E., Kokonozi, A., Chouvarda, I., and Maglaveras, N. (2008, January 20–25). EEG and HRV Markers of Sleepiness and Loss of Control during Car Driving. Vancouver, BC, Canada. Kobayashi EMG/ECG acquisition system with online adjustable parameters using zigbee wireless technology IEEE Trans. Electron. Inform. Syst 2012 132 632 Klingeberg Mobile wearable device for long term monitoring of vital signs Comput. Meth. Prog. Biomed 2012 10.1016/j.cmpb.2011.12.009 106 89 Yu, X. (2009). Real-Time Nonintrusive Detection of Driver Drowsiness, Technical Report for University of Minnesota. Casanella A fast and easy-to-use ECG acquisition and heart rate monitoring system using a wireless steering wheel IEEE Sens. J 2012 10.1109/JSEN.2011.2118201 12 610 Hyun A Smart health monitoring chair for nonintrusive measurement of biological signals IEEE Trans. Inform. Technol. Biomed 2012 10.1109/TITB.2011.2175742 16 150 Lee Multi-classifier for highly reliable driver drowsiness detection in Android platform Biomed. Eng. Appl. Basis Commun 2012 10.4015/S1016237212500159 24 147 Hii A comprehensive ubiquitous healthcare solution on an Android™ mobile device Sensors 2011 10.3390/s110706799 11 6799 Blana Differences between vehicle lateral displacement on the road and in a fixed-base simulator Hum. Factors 2002 10.1518/0018720024497899 44 303 Johansson Effects of visual and cognitive load in real and simulated motorway driving Transport. Res. Traffic Psychol. Behav 2005 10.1016/j.trf.2005.04.012 8 97 Lawrence, B., Stephen, P., and Howarth, H. (2009). An Evaluation of Emerging Driver Fatigue Detection Measures and Technologies, Volpe National Transportation Systems Center Cambridge. Sloten, J., Verdonck, P., Nyssen, M., Haueisen, J., Mizuno, A., Okumura, H., and Matsumura, M. (2008, January 23–27). Development of Neckband Mounted Active Bio-Electrodes for Non-Restraint Lead Method of ECG R Wave. Antwerp, Belgium. Lee Real-time physiological and vision monitoring of vehicle driver for non-intrusive drowsiness detection Commun. IET 2011 10.1049/iet-com.2010.0925 5 2461 Solaz Controlled inducement and measurement of drowsiness in a driving simulator Intell. Trans. Syst. IET 2010 10.1049/iet-its.2009.0110 4 280 Cheng Driver drowsiness detection based on multisource information Hum. Factors Ergon. Manuf. Serv. Indust 2012 10.1002/hfm.20395 22 450