Journal of Astronautics ›› 2022, Vol. 43 ›› Issue (8): 1061-1069.doi: 10.3873/j.issn.1000-1328.2022.08.008

Previous Articles     Next Articles

A Distributed Reinforcement Learning Guidance Method under Impact Angle Constraints

LI Bohao, AN Xuman, YANG Xiaofei, WU Yunjie, LI Guofei   

  1. 1. State Key Laboratory of Virtual Reality Technology and System, Beihang University, Beijing 100191, China;2. School of Automation Science and Electrical Engineering, Beihang University, Beijing 100191, China;3. Science and Technology on Aircraft Control Laboratory, Beijing 100191, China;4. School of Astronautics, Northwestern Polytechnical University, Xi’an 710072, China
  • Received:2021-12-31 Revised:2022-03-28 Online:2022-08-15 Published:2022-08-15

Abstract: In order to improve the target hitting effect of missile with the impact angle fixed, a distributed reinforcement learning guidance strategy based on deep deterministic policy gradient algorithm is proposed. To minimize the impact angle error, a new reward function is designed to make the line of sight angle converge to the expected value while meeting the field of view angle constraint. In addition, in order to enhance the generalization ability of the reinforcement learning model, a distributed exploration strategy is proposed to improve the efficiency of environment exploration during model training. The simulation results verify that the proposed distributed reinforcement learning guidance method can achieve accurate attack on the target under the constraint of fixed impact angle. Compared with the traditional guidance law, the impact angle error of the proposed guidance law is smaller and the convergence rate is faster.

Key words: Missile guidance, Reinforcement learning, Impact angle, Gradient algorithm

CLC Number: