A Learning-based Adaptive Group-based Signal Control System under Oversaturated Conditions
2016 (English)In: IFAC-PapersOnLine, ISSN 2405-8963, Vol. 49, no 5, 291-296 p.Article in journal (Refereed) Published
The operation of traffic signal control is of significant importance in traffic management and operation practice, especially under oversaturated condition during the morning and afternoon peak hours. However, the conventional signal control systems showed the limitations in signal timing and phasing under oversaturated situations. This paper proposes a multi-agent adaptive signal control system in the context of group-based phasing techniques. The adaptive signal control system is able to acquire knowledge on-line based on the perceived traffic states and the feedback from the traffic environment. Reinforcement learning with eligibility trace is applied as the learning algorithm in the multi-agent system. As a result, the signal controller makes an intelligent timing decision. Feature-based function approximation method is incorporated into reinforcement learning framework to improve the learning efficiency as well as the quality of signal timing decisions. The learning process of the learning-based signal control is carried out with the aid of a microscopic traffic simulation model. A benchmarking system, an optimized group-based vehicle actuated signal control system, is compared with the proposed adaptive signal control systems. The simulation results show that the proposed adaptive group-based signal control system has the potential to improve the mobility efficiency under different congested situations.
Place, publisher, year, edition, pages
Elsevier, 2016. Vol. 49, no 5, 291-296 p.
Intelligent transport system; adaptive signal control; group-based phasing; multi-agent system; multi-agent system; reinforcement learning; oversaturated signal control.
Transport Systems and Logistics Computer Science
Research subject Computer Science; Transport Science
IdentifiersURN: urn:nbn:se:kth:diva-190616DOI: 10.1016/j.ifacol.2016.07.128ISI: 000381503600050OAI: oai:DiVA.org:kth-190616DiVA: diva2:952330
QC 201608222016-08-122016-08-122016-09-20Bibliographically approved