Batch Reinforcement Learning for Optimizing Longitudinal Driving Assistance Strategies

Olivier Pietquin (1, 2) , Fabio Tango (3) , Raghav Aras (1)

1 SUPELEC-Campus Metz
2 Georgia Tech Lorraine [Metz]
3 CRF - Centro Ricerche Fiat

Partially Autonomous Driver's Assistance Systems (PADAS) are systems aiming at providing a safer driving experience to people. Especially, one application of such systems is to assist the drivers in reacting optimally so as to prevent collisions with a leading vehicle. Several means can be used by a PADAS to reach this goal. For instance, warning signals can be sent to the driver or the PADAS can actually modify the speed of the car by braking automatically. An optimal combination of different warning signals together with assistive braking is expected to reduce the probability of collision. How to associate the right combination of PADAS actions to a given situation so as to achieve this aim remains an open problem. In this paper, the use of a statistical machine learning method, namely the reinforcement learning paradigm, is proposed to automatically derive an optimal PADAS action selection strategy from a database of driving experiments. Experimental results conducted on actual car simulators with human drivers show that this method achieves a significant reduction of the risk of collision.

Domains: Machine Learning [cs.LG]

Olivier Pietquin, Fabio Tango, Raghav Aras. Batch Reinforcement Learning for Optimizing Longitudinal Driving Assistance Strategies. CIVTS 2011, Apr 2011, Paris, France. pp.73-79, ⟨10.1109/CIVTS.2011.5949533⟩. ⟨hal-00617644⟩