Abstract: This paper proposes a combination of Proximal Policy Optimization (PPO), Simulated Annealing (SA) algorithm and Time-sensitive Network (Time-Sensitive Network). The reinforcement learning ...