Administrator by China Associction for Science and Technology
Sponsored by China Society of Automotive Engineers
Published by AUTO FAN Magazine Co. Ltd.

Automotive Engineering ›› 2024, Vol. 46 ›› Issue (11): 1937-1951.doi: 10.19562/j.chinasae.qcgc.2024.11.001

    Next Articles

Large Model Alignment Technology for Autonomous Driving: A Review

Xiaolin Tang1,Lu Gan1,Guofa Li1,Keqiang Li2,Wenbo Chu3,4,5()   

  1. 1.College of Mechanical and Vehicle Engineering,Chongqing University,Chongqing 400044
    2.School of Vehicle and Mobility,Tsinghua University,Beijing 100084
    3.China Intelligent and Connected Vehicles (Beijing) Research Institute Co. ,Ltd. ,Beijing 100176
    4.Engineering Research Center of Mechanical Testing Tech. and Equip. Ministry of Education,Chongqing University of Technology,Chongqing 400054
    5.Western China Science City Innovation Center of Intelligent and Connected Vehicles (Chongqing) Co. ,Ltd. ,Chongqing 401329
  • Received:2024-01-23 Revised:2024-03-26 Online:2024-11-25 Published:2024-11-22
  • Contact: Wenbo Chu E-mail:chuwenbo@wicv.cn

Abstract:

With the emergence of the Transformer attention mechanism, general-purpose large models represented by GPT have achieved the "emergence" of intelligence, bringing a dawn to the advancement towards higher levels of autonomous driving. Limited by the traditional from-scratch pre-training approach, which requires large-scale, high-quality, diverse autonomous driving data and incurs high training cost, the "large model + alignment technology" paradigm has been derived. As a bridge between general-purpose large models and autonomous driving, alignment technology, through customization methods such as fine-tuning or prompt engineering, achieves efficient and professional solutions to engineering problems within the field of autonomous driving. Alignment technology has become a hot research topic in the development of large models in vertical fields, but it lacks systematic research results. Based on this, this article firstly provides an overview of the development of autonomous driving and large model technology, thereby deriving alignment technology. Then, it reviews from the perspectives of fine-tuning and prompt engineering, systematically reviewing and analyzing the structure or performance characteristics of each classification technology, while providing actual application cases. Finally, based on existing research, the research challenges and development trends of alignment technology are proposed, offering references for promoting the advancement towards higher level of autonomous driving development.

Key words: autonomous driving, large model, review, alignment technology, fine-tuning, prompt engineering