Safe and Trustworthy Human-Centered Mobility: Leveraging Foundation Models and Digital Twins for Vulnerable Road User-Vehicle Interactions
The HUMANE (HUman-centered Mobility Agent iNtEraction) framework introduces an innovative approach to enhancing safety and trust in autonomous vehicle interactions with vulnerable road users (VRUs) by integrating foundation models with digital twin technology. This project addresses critical challenges in human-agent interaction within complex urban environments through three integrated modules: (1) a multimodal human intent recognition system leveraging foundation models, (2) a trustworthy interactive learning framework incorporating human feedback, and (3) an enhanced digital twin validation platform. The framework will be validated through both high-fidelity simulation and real-world testing at a signal-controlled intersection in Madison, Wisconsin, using the lab-developed autonomous vehicle fleet and roadside infrastructure. Building upon previous Center for Connected and Automated Transportation (CCAT)-funded research in VR-based interaction platforms and hardware system integration, HUMANE represents a significant advancement in creating safe and efficient autonomous transportation systems that can naturally interact with all road users. The project will deliver open-source software, comprehensive datasets, and educational materials, contributing to both academic advancement and practical implementation in the field of connected and autonomous vehicles.
Language
- English
Project
- Status: Active
- Funding: $170,000.00
-
Contract Numbers:
69A3552348305
-
Sponsor Organizations:
Office of the Assistant Secretary for Research and Technology
University Transportation Centers Program
Department of Transportation
Washington, DC United States 20590 -
Managing Organizations:
University of Michigan Transportation Research Institute
2901 Baxter Road
Ann Arbor, Michigan United States 48109 -
Project Managers:
Bezzina, Debra
Stearns, Amy
-
Performing Organizations:
University of Wisconsin, Madison
Department of Civil and Environmental Engineering
1415 Engineering Drive
Madison, WI United States 53706 -
Principal Investigators:
Chen, Sikai
- Start Date: 20251015
- Expected Completion Date: 20261015
- Actual Completion Date: 0
- USDOT Program: University Transportation Centers Program
Subject/Index Terms
- TRT Terms: Autonomous vehicles; Connected vehicles; Digital twins; Machine learning; Pedestrian vehicle interface; Psychological trust; Traffic safety; Vulnerable road users
- Subject Areas: Data and Information Technology; Highways; Pedestrians and Bicyclists; Safety and Human Factors; Vehicles and Equipment;
Filing Info
- Accession Number: 01970971
- Record Type: Research project
- Source Agency: Center for Connected and Automated Transportation
- Contract Numbers: 69A3552348305
- Files: UTC, RIP
- Created Date: Nov 13 2025 3:59PM