Find convergence for my existing reinforcement learning project using A2C and DDQN

I need help in finding convergence for my existing reinforcement learning project by using A2C and DDQN by observing the weight of neurons in the neural network got stable.