Real-Time Face Replacement / Digital Avatar Expert for Virtual Performance & Simulation
Budget: $25 – $50 USD
We are seeking a technically skilled specialist in real-time face tracking and replacement to assist us in creating a virtual character system for live video environments.
The core objective is to enable a performer or speaker to appear on camera as a predefined digital identity or character, with full real-time synchronization of facial expressions, lip movement, and gestures — to be used in virtual performances, interactive roleplay, or simulated training sessions.
This technology will support scenarios such as:
Training environments where actors represent standardized personas (e.g., customer support simulations)
Creative performances using virtual faces or characters
Privacy-preserving appearances, where the speaker prefers not to show their real identity but still engages with natural facial presence
Responsibilities:
Develop or adapt a real-time face animation pipeline
Implement accurate expression and lip-sync mapping from webcam input
Ensure integration with live video platforms (Zoom, Meet, OBS, etc.)
Optimize for low latency and high visual realism
Preferred Technologies:
MetaHuman, DeepMotion, NVIDIA Maxine, Unreal Engine, or custom ML pipelines
WebRTC, OBS Studio, Zoom SDK, or equivalent
(Bonus) Experience with voice masking or modulation
Deliverable:
A working demo in which:
A person appears on camera with the facial identity of a predefined character
The face animates in sync with their speech and movements
It works seamlessly in live call settings
Collaboration:
We’re looking for a clear communicator with a creative mindset, ideally available for regular alignment calls. Please share previous work or demo materials related to face animation, digital avatars, or virtual character systems.
The core objective is to enable a performer or speaker to appear on camera as a predefined digital identity or character, with full real-time synchronization of facial expressions, lip movement, and gestures — to be used in virtual performances, interactive roleplay, or simulated training sessions.
This technology will support scenarios such as:
Training environments where actors represent standardized personas (e.g., customer support simulations)
Creative performances using virtual faces or characters
Privacy-preserving appearances, where the speaker prefers not to show their real identity but still engages with natural facial presence
Responsibilities:
Develop or adapt a real-time face animation pipeline
Implement accurate expression and lip-sync mapping from webcam input
Ensure integration with live video platforms (Zoom, Meet, OBS, etc.)
Optimize for low latency and high visual realism
Preferred Technologies:
MetaHuman, DeepMotion, NVIDIA Maxine, Unreal Engine, or custom ML pipelines
WebRTC, OBS Studio, Zoom SDK, or equivalent
(Bonus) Experience with voice masking or modulation
Deliverable:
A working demo in which:
A person appears on camera with the facial identity of a predefined character
The face animates in sync with their speech and movements
It works seamlessly in live call settings
Collaboration:
We’re looking for a clear communicator with a creative mindset, ideally available for regular alignment calls. Please share previous work or demo materials related to face animation, digital avatars, or virtual character systems.