Convert coordinates of an image to match coordinates of data collected from an eye tracker (Math problem)

I have some data from an eye tracker and a panoramic image. The data from the eye tracker includes vectors in 3D from the user gaze. I also have a panoramic image of a task that the user had to complete in Unity. The aim of this project is to interesct the gaze direction vectors with the image and aggregate those locations. Then using this data I want to plot a heatmap on the panoramic image.