Python AI markov decision process -- 2

Are you familiar with the markov decision process?

I need to implement questions 1.1 and 1.2.

1.2's priority is high than 1.1.

So you'll be starting from scratch with that one

I have test files.

I don't have anything for 1.2 so you can just make your own A3.py and import numpy as np.

I attach the test case files.

Those will test your code for both parts.

I recommend you start 1.2 from scratch and maybe by the time you finish it ill send you my 1.1 code.

Thank you.