Unreal Developer Needed: Glove Puppet (Face via iPhone Live Link, Fingers via Meta Quest 2 Hand Tracking)
Budget: $30 – $250 AUD
Good morning from Sydney, I am looking for a developer with strong Unreal Engine 5.4+ experience to help build a real-time digital puppet for live performance. The goal is to bring the main character from a graphic novel to life as a part of a life performance of the graphic novel.
The puppet is a glove with a stylized face on the palm, and it will be controlled in two ways:
• Facial animation via iPhone Live Link (capturing the performer’s face)
• Finger movement via Meta Quest 2 hand tracking (no controllers)
This will be performed live, solo, and projected on a screen — so the final setup must be stable, easy to troubleshoot, and intuitive for use on the road.
The head rotation comes from the iPhone, but the focus here is integrating facial and hand input into one clean, working system. You should be comfortable wiring up Live Link face capture, OpenXR hand joints, and controlling a skeletal mesh in Blueprint.
In addition to the puppet, I’ll need a system for switching backgrounds, triggering audio cues and changing scenes, including virtual 2d props during the performance — likely driven by keyboard or controller shortcuts. This includes managing timed sequences or toggling actors in and out of the scene. If you’ve built similar interactive setups, performance rigs, or XR experiences in Unreal, I’d love to see what we could make.
Please provide a portfolio showcasing relevant experience.
X g
The puppet is a glove with a stylized face on the palm, and it will be controlled in two ways:
• Facial animation via iPhone Live Link (capturing the performer’s face)
• Finger movement via Meta Quest 2 hand tracking (no controllers)
This will be performed live, solo, and projected on a screen — so the final setup must be stable, easy to troubleshoot, and intuitive for use on the road.
The head rotation comes from the iPhone, but the focus here is integrating facial and hand input into one clean, working system. You should be comfortable wiring up Live Link face capture, OpenXR hand joints, and controlling a skeletal mesh in Blueprint.
In addition to the puppet, I’ll need a system for switching backgrounds, triggering audio cues and changing scenes, including virtual 2d props during the performance — likely driven by keyboard or controller shortcuts. This includes managing timed sequences or toggling actors in and out of the scene. If you’ve built similar interactive setups, performance rigs, or XR experiences in Unreal, I’d love to see what we could make.
Please provide a portfolio showcasing relevant experience.
X g
Related categories:
Animation
3D Modelling
Game Development
Augmented Reality
Unreal Engine
Virtual Reality