• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Du, Heng (Du, Heng.) [1] | Lin, Dingfa (Lin, Dingfa.) [2] | Zhang, Xiaolong (Zhang, Xiaolong.) [3] | Wei, Lingtao (Wei, Lingtao.) [4] | Zhou, Shizhao (Zhou, Shizhao.) [5] | Cheng, Xuanhao (Cheng, Xuanhao.) [6] | Zhang, Luxin (Zhang, Luxin.) [7] | Jiang, Jin (Jiang, Jin.) [8]

Indexed by:

EI

Abstract:

Hierarchical reinforcement learning (HRL) has demonstrated considerable promise in addressing complex driving tasks. However, existing HRL-based autonomous driving decision systems face challenges such as inefficient convergence, lack of interdependence among driving maneuver strategies (including throttle/brake control and steering adjustments), and inadequate risk assessment mechanisms, all of which impede the safety and stability of lane-changing decisions. This study proposes a novel HRL framework for continuous lane-changing decision planning. This framework establishes cascaded relationships between driving maneuvers strategies and integrates a comprehensive risk assessment mechanism to address these challenges. Initially, a hierarchical decision model is developed, where the high-level determines the lane-changing intent, while the low-level manages continuous and precise maneuvers. Subsequently, by integrating a Bayesian network, the cascading between throttle/brake openings and steering angles is achieved, optimizing the system's joint strategy distribution. Furthermore, a comprehensive risk assessment mechanism that evaluates the cooperation level of drivers and the severity of potential collisions is designed to encourage agents to adopt strategies that minimize risk. The effectiveness of the proposed decision-making framework has been validated through comparative experiments in mixed traffic scenarios simulated within the Car Learning to Act (CARLA) environment and corroborated with human driving data from the Next Generation Simulation (NGSIM) database. © 2025 Elsevier Ltd

Keyword:

Automobile drivers Automobile steering equipment Bayesian networks Cascade control systems Decision making Decision theory Deep learning Deep reinforcement learning Hierarchical systems Learning algorithms

Community:

  • [ 1 ] [Du, Heng]School of Mechanical Engineering and Automation, Fuzhou University, Fuzhou; 350108, China
  • [ 2 ] [Lin, Dingfa]School of Advanced Manufacturing, Fuzhou University, Jinjiang; 362251, China
  • [ 3 ] [Zhang, Xiaolong]School of Mechanical Engineering and Automation, Fuzhou University, Fuzhou; 350108, China
  • [ 4 ] [Wei, Lingtao]School of Mechanical Engineering and Automation, Fuzhou University, Fuzhou; 350108, China
  • [ 5 ] [Zhou, Shizhao]School of Mechanical Engineering and Automation, Fuzhou University, Fuzhou; 350108, China
  • [ 6 ] [Cheng, Xuanhao]School of Mechanical Engineering and Automation, Fuzhou University, Fuzhou; 350108, China
  • [ 7 ] [Zhang, Luxin]School of Mechanical Engineering and Automation, Fuzhou University, Fuzhou; 350108, China
  • [ 8 ] [Jiang, Jin]Xiamen King Long United Automotive Industry Co., Xiamen; 361023, China

Reprint 's Address:

Email:

Show more details

Related Keywords:

Source :

Engineering Applications of Artificial Intelligence

ISSN: 0952-1976

Year: 2025

Volume: 158

7 . 5 0 0

JCR@2023

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 0

Affiliated Colleges:

Online/Total:540/11081445
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1