考虑主观认知的自动驾驶汽车序贯博弈类人决策

doi:10.19562/j.chinasae.qcgc.2024.ep.003

Abstract

Abstract:

Uncontrolled intersections are highly dynamic and strongly interactive decision-making scenarios， in which it is a challenging task to enable automated vehicles to make safe and reasonable decisions similar to skilled drivers and pass through the intersections successfully. The subjective attributes of ontology in cognition and decision-making process are fully considered in this paper， and an interactive human-like decision-making method based on sequential games for automated vehicles is proposed. Firstly， the multi-objective driving triggers are deeply explored from multiple dimensions such as traffic efficiency， space margin， ride experience， and driving safety. Further， a game decision-making model is established， which is embedded with personalized and human-like driving characteristics and can match driver and passenger groups with different driving modes and types. On this basis， the concept of sequential priority and the self-perspective decision-making scheme that imitates human logic are proposed to realize self-evolution of sequential patterns of rolling stage game decision-making. Finally， the effectiveness of the proposed method is verified through multiple sets of comparative experiments. The results show that the interactive human-like decision-making method proposed in this paper can resolve potential conflicts and deal with safety decision-making problems in a continuous and interactive manner， while improving the naturalized and human-like effect of personalized decision-making of automated vehicles.

Key words: automated vehicles, human-like decision-making, sequential game, subjective cognition, uncontrolled intersections

Bing Zhu,Shizheng Jia,Jian Zhao,Jiayi Han,Peixing Zhang,Dongjian Song,Zhicheng Chen. Human-Like Decision-Making Based on Sequential Games for Automated Vehicles Considering Subjective Cognition[J].Automotive Engineering, 2025, 47(1): 13-22.

Figures/Tables 10

References 30

1	FENG S， SUN H， YAN X， et al. Dense reinforcement learning for safety validation of autonomous vehicles［J］. Nature， 2023， 615（7953）： 620-627.
2	NOH S， AN K. Decision-making framework for automated driving in highway environments［J］. IEEE Transactions on Intelligent Transportation Systems， 2017， 19（1）： 58-71.
3	KOLEKAR S， DE WINTER J， ABBINK D. Human-like driving behaviour emerges from a risk-based driver model［J］. Nature Communications， 2020， 11（1）： 1-13.
4	HUBMANN C， SCHULZ J， BECKER M， et al. Automated driving in uncertain environments： planning with interaction and uncertain maneuver prediction［J］. IEEE Transactions on Intelligent Vehicles， 2018， 3（1）： 5-17.
5	NOH S. Decision-making framework for autonomous driving at road intersections： safeguarding against collision， overly conservative behavior， and violation vehicles［J］. IEEE Transactions on Industrial Electronics， 2018， 66（4）： 3275-3286.
6	AHN H， DEL VECCHIO D. Safety verification and control for collision avoidance at road intersections［J］. IEEE Transactions on Automatic Control， 2017， 63（3）： 630-642.
7	DE CAMPOS G R， FALCONE P， HULT R， et al. Traffic coordination at road intersections： autonomous decision-making algorithms using model-based heuristics［J］. IEEE Intelligent Transportation Systems Magazine， 2017， 9（1）： 8-21.
8	HAFNER M R， CUNNINGHAM D， CAMINITI L， et al. Cooperative collision avoidance at intersections： algorithms and experiments［J］. IEEE Transactions on Intelligent Transportation Systems， 2013， 14（3）： 1162-1175.
9	WANG P， CHAN C Y. Vehicle collision prediction at intersections based on comparison of minimal distance between vehicles and dynamic thresholds［J］. IET Intelligent Transport Systems， 2017， 11（10）： 676-684.
10	REN Y， ZHAN G， TANG L， et al. Improve generalization of driving policy at signalized intersections with adversarial learning［J］. Transportation Research Part C： Emerging Technologies， 2023， 152： 104161.
11	LIAO H， HE Y， WU X， et al. Reimagining multi-criterion decision making by data-driven methods based on machine learning： a literature review［J］. Information Fusion， 2023： 101970.
12	BHATTACHARYYA R， WULFE B， PHILLIPS D J， et al. Modeling human driving behavior through generative adversarial imitation learning［J］. IEEE Transactions on Intelligent Transportation Systems， 2022， 24（3）： 2874-2887.
13	JO K， KIM J， KIM D， et al. Development of autonomous car—part II： a case study on the implementation of an autonomous driving system based on distributed architecture［J］. IEEE Transactions on Industrial Electronics， 2015， 62（8）： 5119-5132.
14	HU H， JIA X， LIU K， et al. Self-adaptive traffic control model with behavior trees and reinforcement learning for AGV in industry 4.0［J］. IEEE Transactions on Industrial Informatics， 2021， 17（12）： 7968-7979.
15	JIA S， LI X， LYU Y， et al. Simulation research on safety and anti-collision strategy of typical intersection based on hazard cognition［C］. 2019 Chinese Automation Congress （CAC）. IEEE， 2019： 2652-2657.
16	LI K， XIONG H， YU D， et al. An end-to-end multi-task learning model for drivable road detection via edge refinement and geometric deformation［J］. IEEE Transactions on Intelligent Transportation Systems， 2021， 23（7）： 8641-8651.
17	MNIH V， KAVUKCUOGLU K， SILVER D， et al. Human-level control through deep reinforcement learning［J］. Nature， 2015， 518（7540）： 529-533.
18	MIN K， KIM H， HUH K. Deep distributional reinforcement learning based high-level driving policy determination［J］. IEEE Transactions on Intelligent Vehicles， 2019， 4（3）： 416-424.
19	DI X， SHI R. A survey on autonomous vehicle control in the era of mixed-autonomy： from physics-based to AI-guided driving policy learning［J］. Transportation Research Part C： Emerging Technologies， 2021， 125： 103008.
20	NA X， COLE D J. Modelling of a human driverʼ s interaction with vehicle automated steering using cooperative game theory［J］. IEEE/CAA Journal of Automatica Sinica， 2019， 6（5）： 1095-1107.
21	HANG P， LV C， HUANG C， et al. An integrated framework of decision making and motion planning for autonomous vehicles considering social behaviors［J］. IEEE Transactions on Vehicular Technology， 2020， 69（12）： 14458-14469.
22	HANG P， ZHANG Y， LV C. Brain-inspired modeling and decision-making for human-like autonomous driving in mixed traffic environment［J］. IEEE Transactions on Intelligent Transportation Systems， 2023.
23	LI N， YAO Y， KOLMANOVSKY I， et al. Game-theoretic modeling of multi-vehicle interactions at uncontrolled intersections［J］. IEEE Transactions on Intelligent Transportation Systems， 2020， 23（2）： 1428-1442.
24	TIAN R， LI N， KOLMANOVSKY I， et al. Game-theoretic modeling of traffic in unsignalized intersection network for autonomous vehicle control verification and validation［J］. IEEE Transactions on Intelligent Transportation Systems， 2020， 23（3）： 2211-2226.
25	HANG P， LV C， HUANG C， et al. Human-like lane-change decision making for automated driving with a game theoretic approach［C］. 2020 4th CAA International Conference on Vehicular Control and Intelligence （CVCI）. IEEE， 2020： 708-713.
26	YAN X Y， ZHOU T. Destination choice game： a spatial interaction theory on human mobility［J］. Scientific Reports， 2019， 9（1）： 9466.
27	NA X， COLE D J. Game-theoretic modeling of the steering interaction between a human driver and a vehicle collision avoidance controller［J］. IEEE Transactions on Human-Machine Systems， 2014， 45（1）： 25-38.
28	JIA S， ZHANG Y， LI X， et al. Interactive decision-making with switchable game modes for automated vehicles at intersections［J］. IEEE Transactions on Intelligent Transportation Systems， 2023.
29	LIU M， WAN Y， LEWIS F L， et al. A three-level game-theoretic decision-making framework for autonomous vehicles［J］. IEEE Transactions on Intelligent Transportation Systems， 2022， 23（11）： 20298-20308.
30	ZHANG Q， LANGARI R， TSENG H E， et al. A game theoretic model predictive controller with aggressiveness estimation for mandatory lane change［J］. IEEE Transactions on Intelligent Vehicles， 2019， 5（1）： 75-89.

[1]	Guojuan Zhang,Hongyu Hu,Haomiao Li,Mingjian Wang,Fei Gao,Zhenhai Gao. A Survey on Ride Comfort Evaluation of Autonomous Vehicles [J]. Automotive Engineering, 2024, 46(9): 1617-1627.
[2]	Jian Sun,He Zhang,Xiaocong Zhao,Yiru Liu,Ye Tian. Interactive Scenarios Strategy Modeling and Simulation for Automated Driving Testing [J]. Automotive Engineering, 2024, 46(11): 1962-1972.
[3]	Jizheng Liu,Zhenpo Wang,Fengchun Sun,Lei Zhang. Research on Delay Compensation Control for Heterogeneous Connected and Automated Vehicle Platoons [J]. Automotive Engineering, 2023, 45(9): 1573-1582.
[4]	Xianglei Zhu,Zhixin Wu,Yufei Zhang,Shuai Zhao,Keqiu Li,Bohua Sun. Research on Scenario Library Optimization Method Based on Scenario Dimension Reduction and Sampling Method [J]. Automotive Engineering, 2023, 45(8): 1408-1416.
[5]	Lijun Qian,Chen Chen,Jian Chen,Xinyu Chen,Chi Xiong. Discrete Platoon Control at an Unsignalized Intersection Based on Q-learning Model [J]. Automotive Engineering, 2022, 44(9): 1350-1358.
[6]	Qiaobin Liu,Lu Yang,Bolin Gao,Jianqiang Wang,Keqiang Li. Car Following Model for Intelligent Vehicles Based on Dynamic Balance of Perception Risk [J]. Automotive Engineering, 2022, 44(11): 1627-1635.

Human-Like Decision-Making Based on Sequential Games for Automated Vehicles Considering Subjective Cognition

RichHTML

PDF (PC)

Like

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 10

References 30

Related Articles 6

Metrics

Comments

Recommended 0