Open Access iconOpen Access

ARTICLE

crossmark

Perception Enhanced Deep Deterministic Policy Gradient for Autonomous Driving in Complex Scenarios

Lyuchao Liao1,2, Hankun Xiao2,*, Pengqi Xing2, Zhenhua Gan1,2, Youpeng He2, Jiajun Wang2

1 Fujian Provincial Key Laboratory of Automotive Electronics and Electric Drive, Fujian University of Technology, Fuzhou, 350118, China
2 Fujian Provincial Universities Engineering Research Center for Intelligent Driving Technology, Fuzhou, 350118, China

* Corresponding Author: Hankun Xiao. Email: email

(This article belongs to the Special Issue: Intelligent Analysis of Imperfect Data in Complex Scenes: Modeling, Learning, and Optimization)

Computer Modeling in Engineering & Sciences 2024, 140(1), 557-576. https://doi.org/10.32604/cmes.2024.047452

Abstract

Autonomous driving has witnessed rapid advancement; however, ensuring safe and efficient driving in intricate scenarios remains a critical challenge. In particular, traffic roundabouts bring a set of challenges to autonomous driving due to the unpredictable entry and exit of vehicles, susceptibility to traffic flow bottlenecks, and imperfect data in perceiving environmental information, rendering them a vital issue in the practical application of autonomous driving. To address the traffic challenges, this work focused on complex roundabouts with multi-lane and proposed a Perception Enhanced Deep Deterministic Policy Gradient (PE-DDPG) for Autonomous Driving in the Roundabouts. Specifically, the model incorporates an enhanced variational autoencoder featuring an integrated spatial attention mechanism alongside the Deep Deterministic Policy Gradient framework, enhancing the vehicle’s capability to comprehend complex roundabout environments and make decisions. Furthermore, the PE-DDPG model combines a dynamic path optimization strategy for roundabout scenarios, effectively mitigating traffic bottlenecks and augmenting throughput efficiency. Extensive experiments were conducted with the collaborative simulation platform of CARLA and SUMO, and the experimental results show that the proposed PE-DDPG outperforms the baseline methods in terms of the convergence capacity of the training process, the smoothness of driving and the traffic efficiency with diverse traffic flow patterns and penetration rates of autonomous vehicles (AVs). Generally, the proposed PE-DDPG model could be employed for autonomous driving in complex scenarios with imperfect data.

Keywords


Cite This Article

APA Style
Liao, L., Xiao, H., Xing, P., Gan, Z., He, Y. et al. (2024). Perception enhanced deep deterministic policy gradient for autonomous driving in complex scenarios. Computer Modeling in Engineering & Sciences, 140(1), 557-576. https://doi.org/10.32604/cmes.2024.047452
Vancouver Style
Liao L, Xiao H, Xing P, Gan Z, He Y, Wang J. Perception enhanced deep deterministic policy gradient for autonomous driving in complex scenarios. Comput Model Eng Sci. 2024;140(1):557-576 https://doi.org/10.32604/cmes.2024.047452
IEEE Style
L. Liao, H. Xiao, P. Xing, Z. Gan, Y. He, and J. Wang "Perception Enhanced Deep Deterministic Policy Gradient for Autonomous Driving in Complex Scenarios," Comput. Model. Eng. Sci., vol. 140, no. 1, pp. 557-576. 2024. https://doi.org/10.32604/cmes.2024.047452



cc This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
  • 121

    View

  • 119

    Download

  • 0

    Like

Share Link