Archive > Volume 20 Issue 12 > 2024,20(12):764-768. DOI:https://doi.org/10.1007/s11801-024-3267-2 CSTR: Prev Next
Fairness-aware multi-agent reinforcement learning and visual perception for adaptive traffic signal control
- Article
- Figures
- Metrics
- Preview PDF
- Reference
- Related
- Cited by
- Materials
Abstract:
The majority of multi-agent reinforcement learning (MARL) methods for solving adaptive traffic signal control (ATSC) problems are dedicated to maximizing the throughput while ignoring fairness, resulting in a bad situation where some vehicles keep waiting. For this reason, this paper models the ATSC problem as a partially observable Markov game (POMG), in which a value function that combines throughput and fairness is elaborated. On this basis, we propose a new cooperative MARL method of fairness-aware multi-agent proximity policy optimization (FA-MAPPO). In addition, the FA-MAPPO uses graph attention neural networks to efficiently extract state representations from traffic data acquired through visual perception in multi-intersection scenarios. Experimental results in Jinan and synthetic scenarios confirm that the FA-MAPPO improves fairness while guaranteeing passage efficiency compared to the state-of-the-art (SOTA) methods.
Keywords:
Project Supported:
Clc Number:
