Improving an existing agent to probabilistic agent using Python

Need help with a small project on on modifying an agent built for Wumpus World to a probabilistic agent using the Python Pomegranate library. Wumpus World game is from the book "Artificial Intelligence, A Modern Approach". I have the coding for the game environment and the existing agent, and sample code for pomegranate, stuck on how to combine those two