Embedding Human-Understandable Symbolic Rules into Vision-Language Decision Systems for Safe, Transparent, and Ethical Autonomous Driving

In this project, the research team aims to embed human-understandable physical and symbolic rules into the decision-making process of Vision-Language Models (VLMs) for autonomous driving, enabling the model to justify and articulate its decision-making process and consequent driving behavior in real-time. Conventional end-to-end autonomous driving models, i.e., models that learn a direct mapping from raw sensor input (camera, radar, LiDAR) to low-level control commands (steering, throttle, and braking), typically operate as highly complex black-box models. While such models have achieved strong empirical autonomous driving performance, their internal reasoning and decision-making processes are opaque, which makes it difficult for human users to interpret or build trust in the models. Moreover, safety constraints and traffic regulations are often incorporated into these models only as soft constraint penalties during training. As a result, there is no formal guarantee that the probability of generating an unsafe or illegal action is strictly zero at inference. As a result, without an additional safety verification layer, the model may still produce rare but high-risk behaviors, which also may be amplified under distributional shifts or adversarial conditions.

Language

• English

Project

• Status: Active
• Sponsor Organizations:

  Center for Transportation Studies, University of Minnesota

  University Office Plaza, Suite 440
  2221 University Avenue SE
  Minneapolis, MN  United States  55414
• Principal Investigators:

  Choi, Seongjin

• Start Date: 20260301
• Expected Completion Date: 20270228
• Actual Completion Date: 0

Subject/Index Terms

• TRT Terms: Artificial intelligence; Autonomous vehicles; Decision making; Vehicle safety
• Subject Areas: Data and Information Technology; Highways; Safety and Human Factors; Vehicles and Equipment;

Filing Info

• Accession Number: 01999676
• Record Type: Research project
• Source Agency: University of Minnesota, Minneapolis
• Files: RIP
• Created Date: Aug 19 2026 10:42AM