Reinforcement learning for finding an optimal path in a graph

I am working on a reinforcement learning implementation using Q-learning for finding an optimal path for vehicules in a graph which represents a city. The code is in python and it follows the gymnasium library standards. It is almost finished but i am stucked and need help for finish it.