|
Constrained Multi-Objective Deep Reinforcement Learning for Safe and Fair Urban Traffic Signal Control
|
Sara Motamed *   |
| Department of Computer Engineering, FSh.C., Islamic Azad University, Fouman, Iran , motamed.sarah@gmail@gmail.com |
|
|
Abstract: (42 Views) |
This paper presents a constrained multi-objective deep reinforcement learning framework for urban traffic signal control. The problem is modeled as a constrained Markov decision process in which an agent simultaneously optimizes efficiency objectives while respecting explicit safety and fairness constraints. A dueling double deep Q-network (D3QN) is combined with a Lagrangian cost estimator to approximate both the reward value function and cumulative constraint costs. The state representation includes queue lengths, phase indicators and elapsed green times, and the action space consists of a small set of interpretable decisions such as extending the current green or switching to the next phase. The proposed controller is trained and evaluated in a SUMO-based microscopic simulation of a four-leg urban intersection under various traffic demand patterns. Its performance is compared with fixed-time, vehicle-actuated and unconstrained DQN controllers. Simulation results show that the proposed method can substantially reduce average delay and maximum queue length while keeping queue spillback and delay imbalance within predefined limits. These findings indicate that constrained multi-objective deep reinforcement learning offers a promising and practically deployable framework for safe and fair traffic signal control in congested urban networks, and can be extended to more complex corridors and network-wide settings in future work.
|
|
| Keywords: adaptive traffic signal control, deep reinforcement learning, constrained Markov decision process, safe reinforcement learning, multi-objective optimisation, SUMO. |
|
|
Full-Text [PDF 531 kb]
(8 Downloads)
|
Type of Study: Original |
Subject:
Other
Received: 2025/12/9 | Accepted: 2025/12/31 | Published: 2025/12/31
|
|
|
|
|
|
|
| Send email to the article author |
|
|
|
| Add your comments about this article |
|
|
|
