Real-Time Deep Learning Lipsync 3D Avatar
Budget: $750 – $1,500 USD
I need a desktop application for Windows that can create a real-time lipsync to a video avatar from a microphone using deep learning technology. The lipsync will be applied to 3D avatars.
Key Requirements:
- Experience in developing desktop applications specifically for Windows
- Proficient in deep learning technology, particularly in its application to audio-visual synchronisation
- Skilled in creating and manipulating 3D avatars
- Familiarity with real-time system development
- Previous work with lipsync technology is a plus
Your task will be to ensure that the application can accurately sync the avatar's lip movements with the audio input in real-time. The avatars should be able to reflect a range of emotional expressions and reactions, enhancing the realism of the interaction.
Please provide examples of previous projects that demonstrate your skills and experience in this area.
The best case is something like this:
https://getpickle.ai/
And an animated example (just an example we want realistic) is this:
https://manual.reallusion.com/Motion_LIVE_2D_Plugin/Resources/CTA_4/Plugins/Motion_Live_2D/Recording_Audio_and_Lipsync_Animation.htm
Key Requirements:
- Experience in developing desktop applications specifically for Windows
- Proficient in deep learning technology, particularly in its application to audio-visual synchronisation
- Skilled in creating and manipulating 3D avatars
- Familiarity with real-time system development
- Previous work with lipsync technology is a plus
Your task will be to ensure that the application can accurately sync the avatar's lip movements with the audio input in real-time. The avatars should be able to reflect a range of emotional expressions and reactions, enhancing the realism of the interaction.
Please provide examples of previous projects that demonstrate your skills and experience in this area.
The best case is something like this:
https://getpickle.ai/
And an animated example (just an example we want realistic) is this:
https://manual.reallusion.com/Motion_LIVE_2D_Plugin/Resources/CTA_4/Plugins/Motion_Live_2D/Recording_Audio_and_Lipsync_Animation.htm