Abstract: In order to improve the target hitting effect of missile with the impact angle fixed, a distributed reinforcement learning guidance strategy based on deep deterministic policy gradient algorithm is proposed. To minimize the impact angle error, a new reward function is designed to make the line of sight angle converge to the expected value while meeting the field of view angle constraint. In addition, in order to enhance the generalization ability of the reinforcement learning model, a distributed exploration strategy is proposed to improve the efficiency of environment exploration during model training. The simulation results verify that the proposed distributed reinforcement learning guidance method can achieve accurate attack on the target under the constraint of fixed impact angle. Compared with the traditional guidance law, the impact angle error of the proposed guidance law is smaller and the convergence rate is faster.

Key words: Missile guidance, Reinforcement learning, Impact angle, Gradient algorithm