A Reinforcement Learning Framework for Dynamic Inland Waterway Maintenance Under Stochastic Shoaling and Annual Budget Allocation

This research proposes a dynamic, data-driven framework for long-term inland waterway maintenance planning that integrates reinforcement learning (RL), and stochastic modeling. Unlike traditional models that assume deterministic sedimentation, known multi-year budgets, and static decision horizons, the research team models shoaling as a stochastic process, budgets as annually realized random variables, and infrastructure deterioration as a gradual, condition-dependent process. The core of the methodology is an infinite-horizon sequential decision model that makes year-by-year dredging and lock maintenance decisions using RL. Dredging is modeled as a continuous decision variable, and policy learning is guided by a custom-designed simulation environment that reflects realistic physical and institutional constraints. The team trains RL agents using Proximal Policy Optimization (PPO). This work addresses the curse of dimensionality that limits conventional optimization techniques by learning generalizable policies rather than enumerating all possible scenarios. By finding the solution across various uncertainty regimes, the team provides both methodological insights and practical guidance for agencies such as the U.S. Army Corps of Engineers. The resulting framework offers a robust and adaptive tool for managing long-term infrastructure investment under uncertainty

Language

• English

Project

• Funding: $85,000.00
• Sponsor Organizations:

  Office of the Assistant Secretary for Research and Technology

  University Transportation Centers Program
  Department of Transportation
  Washington, DC  United States  20590
• Managing Organizations:

  Maritime Transportation Research and Education Center (MarTREC)

  University of Arkansas
  4190 Bell Engineering Center
  Fayetteville, AR  United States  72701
• Performing Organizations:

  Texas A&M Transportation Institute

  Texas A&M University System
  3135 TAMU
  College Station, TX  United States  77843-3135
• Principal Investigators:

  Wang, Xiubin

• Start Date: 20251001
• Expected Completion Date: 20260930
• Actual Completion Date: 0
• USDOT Program: University Transportation Centers Program

Subject/Index Terms

• TRT Terms: Budgeting; Decision support systems; Dredging; Infrastructure; Inland waterways; Machine learning; Maintenance management; Optimization; Uncertainty
• Subject Areas: Data and Information Technology; Maintenance and Preservation; Marine Transportation; Planning and Forecasting;

Filing Info

• Accession Number: 01970701
• Record Type: Research project
• Source Agency: Maritime Transportation Research and Education Center (MarTREC)
• Files: UTC, RIP
• Created Date: Nov 10 2025 9:33AM