Need help solving matrix iteration code, values end up as NaN using Matlab.

I Need help solving matrix iteration code, values end up as NaN using MATLAB. I will give more detail in the chat.