强化学习在城市交通信号灯控制方法中的应用

 悉尼自适应交通控制系统（SCATS）、绿信比-周期-相位差优化技术（SCOOT）及Smooth采用自适应交通信号灯控制方法，对城市道路口的交通信号灯进行了有效控制。随着深圳城市交通流量急剧增长，深圳交警在自主研发Smooth信号控制式基础上，提出实时、分布式、自适应调控要求，联合创新了人工信号控制方案TrafficGo，探索基于深度神经网络的强化学习，通过在线学习各种流量负荷，实时推理计算信控时段、相位、相序、信号周期、绿信比、相位差，进一步优化了交通信号灯的控制模式。介绍了在交通信号灯控制中运用的强化学习模型，实地测评表明，其取得了一定改进效果。

A survey of the application of reinforcement learning in urban traffic signal control methods

The adaptive traffic signal control method is adopted to effectively control the traffic lights at the urban road junctions, with the rapid growth of the traffic flow in Shenzhen. Shenzhen traffic police asked for a real-time, distributed and adaptive control on the basis of the self-developed smooth signal control. Joint innovation has developed the reinforcement learning based on the deep neural network. Through online learning of various traffic loads, and the real-time reasoning, the information control period, phase, phase sequence, signal cycle, split and phase difference are calculated. This paper reviews the reinforcement learning model used in the traffic signal control, and makes an evaluation on the spot.