Transcribe playing piano into pneumatic actuation

I'm building a wearable haptic device which assists stroke patients/survivors in exercise rehabilitation by artificially helping them to move their fingers for them using soft robotics. (depiction of the project shown in the image attached).

I hope to recruit someone with knowledge in Computer vision, to transcribe videos of people playing the piano into pneumatic actuation that will help to move the fingers for the learner.

Please contact me for more details on the project