MOBILE APP DEVELOPER - UNITY/ OPENCV / VUFORIA

Job ID: 30923509

Budget: $750 – $1,500 USD

Hi everyone
Looking to hire someone to help create one or two .apk files/apps. The apps would use an EXTERNAL USB UVC camera (NOT the built in android cameras) as a VIDEO SOURCE to create real time animation shown on two Android phones. Basically - something similar to AR Instagram/Snapchat filters, just using an external usb camera via OTG as a video source. Budget estimate is $750 - $1500, but it's flexible.

So develop an app using OpenCV / Unity / Mediapipe / Vuforia or any other tool really. I just need to be able to use as a VIDEO INPUT SOURCE an external UVC camera instead of the device's internal camera, detect mouth and eye & eyebrow and create smooth animation. Ideally NOT so CPU intensive.

Please review the video attached. All details are on this link https://docs.google.com/document/d/1KN_u0FZwgzeDi5kvN9EqiJLCrzJaJcGMxgVX91tcgzI/edit?usp=sharing

I will only review freelancers that answer to the questions:

1. Do you have experience using the UVCCamera library? Are you 10000% confident you can implement the UVCCamera library and use a USB webcam as an input source, instead of the built-in camera on Android?

2. Using what tool/software are you going to ACCURATELY track eye & eyebrow and mouth? Do you need me to use markers or wear dark lipstick on my face for more accurate and stable tracking? (ideally I wouldn’t want this) Are you going to use a pre-trained model from OpenCV? Which pre-trained models? Can you explain the process of tracking in more detail? I need to be confident this is going to produce stable non-glitchy tracking.

3. Using what tool or software are you going to create the “ANIMATED” eyes & mouth that will be shown as the final effect/filer? Do you need to use Unity for that? How are you going to pass the data from the UVC camera input to the animation?

4. Can you use an existing .jpg or .gif in Unity or other tool? For example I can design eyes with all effects in Photoshop and just give those to you. Or you need to recreate everything in Unity and add filters on top?

5. It would be great if I could switch the style of the animation myself, for example change the eyes from normal oval-shaped eyes to heart-shaped eyes. I imagine this to be a file or something that I can simply upload into the app and the app would replace whatever style was there before.
Related categories: Android Unity 3D Vuforia OpenCV Android App Development