iOS Skin Extraction & Tracking
Budget: $750 – $1,500 USD
- Use MediaPipe to extract only the skin regions.(Faysics uses mediapipe too)
- Reduce the maximum time between frame captures so it records more frames during fast head movement.
- Important: Make sure to extract and use only good-quality frames.
- Important: Save intermediate data on the phone and add an option to share it via AirDrop. This will help us debug and analyze, similar to our previous Faysics test app.
- Use ARKit to track the head and provide on-screen cues that guide users to take an optimal scan.
- Important: When aligning the 3D mesh with ARKit, remember ARKit coordinates can be inaccurate.
- Previously, we compensated using capped depth values and the ARKit face mesh. It worked sometimes, but not reliably—please try to find a more robust solution.
- Before delivering the full project, provide a demo build like you did before. After reviewing the demo and the code, we will guide you on how to structure the final code so it fits into our existing project.
- Reduce the maximum time between frame captures so it records more frames during fast head movement.
- Important: Make sure to extract and use only good-quality frames.
- Important: Save intermediate data on the phone and add an option to share it via AirDrop. This will help us debug and analyze, similar to our previous Faysics test app.
- Use ARKit to track the head and provide on-screen cues that guide users to take an optimal scan.
- Important: When aligning the 3D mesh with ARKit, remember ARKit coordinates can be inaccurate.
- Previously, we compensated using capped depth values and the ARKit face mesh. It worked sometimes, but not reliably—please try to find a more robust solution.
- Before delivering the full project, provide a demo build like you did before. After reviewing the demo and the code, we will guide you on how to structure the final code so it fits into our existing project.
Related categories:
Mobile App Development
iPhone
Objective C
C++ Programming
Augmented Reality
iOS Development
ARKit
Computer Vision