A Training Framework of Robotic Operation and Image Analysis for Decision-making in Bridge Inspection and Preservation (WD-1)

Inspection and preservation of existing transportation infrastructure to extend their service life is an effective way of mitigating the pressure of steadily growing transportation demands on the aging infrastructure. Their current practice, though, represents one of the most costly operations in state departments of transportation. The INSPIRE University Transportation Center will develop a remotely-controlled robotic platform that helps with these labor-intensive tasks and allows engineers to focus on decision-making processes. An important mission of INSPIRE is to leverage users’ capability of implementing, and interacting with, the robotic platform. Therefore, a long-term plan has been made to create a framework of training engineers and policy makers as well as new workforce on robotic operation and image analysis for the inspection and maintenance of transportation infrastructure. The proposed project, as a component of the plan, involves the prototyping of such a framework based on camera-based bridge inspection and robot-based maintenance. A training framework will be developed through an integration of the following components: (1) a set of training modules to use robotic systems for bridge inspection and maintenance; (2) data processing and pattern recognition algorithms in a semi-supervised way with engineers’ injection; (3) summary and visualization of processed inspection data, recognized patterns, and other research findings; and (4) a set of learning modules, which can be arranged as a customizable training plan for individuals, to help users analyze and use the vision-based materials in their decision making for bridge inspection and preservation. Overall Objectives: This project aims to create a framework of training engineers and policy makers on robotic operation and image analysis for the inspection and preservation of transportation infrastructure. Specifically, it develops the method for collecting camera-based bridge inspection data and the algorithms for data processing and pattern recognitions; creates tools for assisting and training users on visually analyzing the processed image data and recognized patterns for inspection and preservation decision-making. Scope of Work in Year 1: (1) Collect bridge image data using cameras and annotate sample images, (2) Process image data and develop pattern recognition algorithms, (3) Summarize and visualize processed image data and discovered patterns, (4) Develop a training tool for image data analysis and understanding, and (5) Test and validate the prototype framework. Scope of Work in Year 2: (1) Perform semantic image segmentation to automatically detect bridge elements for inspection, (2) Retrieve images containing the bridge elements to be inspected in depth and analyze these images to support inspector’s decision, (3) Use transfer learning to update the semantic segmentation and image retrieval algorithms.


  • English


Subject/Index Terms

Filing Info

  • Accession Number: 01659743
  • Record Type: Research project
  • Source Agency: Inspecting and Preserving Infrastructure through Robotic Exploration University Transportation Center
  • Contract Numbers: 69A3551747126
  • Files: UTC, RIP
  • Created Date: Feb 9 2018 4:19PM