Non-intrusive Driver Fatigue and Stress Monitoring Using Ambient Vibration Sensing

Autonomous vehicles holds tremendous promise in the near future. However, driver intervention will be needed in emergency or difficult situations. Therefore, real-time monitoring of the driver’s states, such as attention level, fatigue, and stress, is important to determine safety for transferring of control. In the past, many single-point on-body sensors and camera systems have been proposed, but these approaches are often limited to certain environments or require intrusive sensors on drivers that are difficult to deploy in reality. This project will use inertial sensors embedded in the vehicle seat for recognizing driver’s physiological states (including movement, cardiovascular functions) and higher level states (including stress, fatigue, and attention level). Advantages of the inertial sensor based driver monitoring system come from its simple and non-intrusive nature, which makes deployment easy. With previous support from the University Transportation Center, the project developed a sensing platform consisting of a network of small vibrational sensors distributed inside car seats and seat belts that can successfully measure posture and breathing of drivers in noisy scenarios. Building on this hardware, the project will continue efforts to develop data processing methods to extract detailed heart rate, heart rhythm, and movement of drivers. The project will then use these vibrations to infer higher level human states, such as stress level, restlessness, and fatigue. The main challenge resides in high noise level due to the moving vehicle and sensing constraints relying only on contacts. To address these challenges, we plan to utilize multi-sourced, high-resolution and high frequency data with hybrid modeling approach to minimize uncertainties in signal processing and obtain reliable information. For this purpose, we will incorporate physical models of human body and vehicle dynamics in addition to data-driven models. The project will continue working with our industry partner (Renault) to evaluate our system for laboratory and field testing.


  • English


  • Status: Active
  • Funding: $80000
  • Sponsor Organizations:

    Office of the Assistant Secretary for Research and Technology

    University Transportation Centers Program
    Department of Transportation
    Washington, DC  United States  20590

    Technologies for Safe and Efficient Transportation University Transportation Center

    Carnegie Mellon University
    Pittsburgh, PA  United States  15213
  • Project Managers:

    Ehrlichman, Courtney

  • Performing Organizations:

    Carnegie Mellon University

    Pittsburgh, PA  United States 
  • Principal Investigators:

    Noh, Hae

    Zhang, Pei

  • Start Date: 20160101
  • Expected Completion Date: 20170131
  • Actual Completion Date: 0

Subject/Index Terms

Filing Info

  • Accession Number: 01586688
  • Record Type: Research project
  • Source Agency: Technologies for Safe and Efficient Transportation University Transportation Center
  • Files: UTC, RiP
  • Created Date: Jan 8 2016 3:24PM