Enhanced Pedestrian and Vehicle Detection Using Surround-view Camera Systems in Rearview Camera Images

Being informed of the objects in the vicinity of a vehicle is critical to maintaining safety while driving. Vision is one of the major sources of sensing when humans are driving. However, many traffic accidents (e.g., backup crashes in parking lots and driveways, lane merging accidents on urban roads and highways, etc.) are caused by inadequate visibility. Vehicle camera systems can assist in improving the situational awareness for the drivers. Reduced driver attention is another major cause of accidents. Even with adequate visualization of the vehicle surroundings, drivers may still ignore such information and not take the necessary safety actions. Such attention lapses can be due to many factors, such as fatigue, alcohol, texting and other distractions. In such situations, computer vision techniques that analyze the images for potential safety problems are likely to significantly reduce the chances and impacts of accidents. Many current automotive vision approaches employ cameras that look in front of the cars or behind the cars whereas some others employ vision systems looking at the blind zones. While such vision systems can improve safety by detecting objects in their separate fields of view, these vision systems work independently. By using an integrated surround view camera system that employs four synchronized cameras (covering 360 degrees), the project can obtain a bird’s eye view of the vehicle surroundings. Resulting integrated surround-view images allow us to achieve improved object (e.g., vehicle, pedestrian) detection performance in challenging scenarios (e.g., when a pedestrian may be too close to the vehicle, presence of other vehicles in adjacent narrow lanes, etc.). The goal of this project is to develop algorithms that detect and track objects (in particular, pedestrians and vehicles) in these integrated surround-view images and videos and demonstrate superior object detection performance that such systems offer.


  • English


  • Status: Completed
  • Funding: $55219
  • Sponsor Organizations:

    Office of the Assistant Secretary for Research and Technology

    University Transportation Centers Program
    Department of Transportation
    Washington, DC  United States  20590
  • Project Managers:

    Ehrlichman, Courtney

  • Performing Organizations:

    Carnegie Mellon University

    Pittsburgh, PA  United States 
  • Principal Investigators:

    Bhagavatula, Vijayakumar

  • Start Date: 20160101
  • Expected Completion Date: 20170102
  • Actual Completion Date: 0

Subject/Index Terms

Filing Info

  • Accession Number: 01586684
  • Record Type: Research project
  • Source Agency: Technologies for Safe and Efficient Transportation University Transportation Center
  • Files: UTC, RiP
  • Created Date: Jan 8 2016 3:15PM