Real-Time Lip Sync Integration
Budget: ₹600 – ₹1,500 INR
I need the Live API endpoint wired into my existing Neko project so that the avatar’s mouth moves in perfect real-time sync with the speech coming from the API. The endpoint returns audio data in WAV format, and the whole project is already structured in Python—every script, model file, and asset you’ll need is in the repo I’ll share.
Here’s what the finished job should achieve:
• Call the Live API, stream or fetch the WAV audio it generates, and immediately route that data into the avatar’s lip-sync driver.
• Keep sync tight enough that users won’t notice lag between voice and mouth (aim for one video frame or better).
• Leave the rest of the project untouched except for the modules you add or patch; everything must still run from the existing main.py entry point.
• Comment new code clearly so I can follow the flow and extend it later.
Once you’ve confirmed the pipeline works smoothly, send me a pull request or zipped project folder plus a short README explaining the new classes or functions and any extra libraries you introduced. I’ll consider the task complete after I run main.py, speak to the avatar, and see its lips track the audio flawlessly.
Here’s what the finished job should achieve:
• Call the Live API, stream or fetch the WAV audio it generates, and immediately route that data into the avatar’s lip-sync driver.
• Keep sync tight enough that users won’t notice lag between voice and mouth (aim for one video frame or better).
• Leave the rest of the project untouched except for the modules you add or patch; everything must still run from the existing main.py entry point.
• Comment new code clearly so I can follow the flow and extend it later.
Once you’ve confirmed the pipeline works smoothly, send me a pull request or zipped project folder plus a short README explaining the new classes or functions and any extra libraries you introduced. I’ll consider the task complete after I run main.py, speak to the avatar, and see its lips track the audio flawlessly.