AI-Driven Real-Time Face Swap Development
Budget: $250 – $750 USD
Real-Time Face Swap System Requirements Specification
1. Project Overview
Purpose:
Development of real-time face replacement functionality aimed at protecting privacy and expanding expressive capabilities during streaming.
Users:
Exclusively for individual streamers.
Streaming Environment:
- Current: Mac mini (M4 chip, 16GB RAM)
- Future: Upgradeable to 32GB/64GB as needed
- OS: Mac preferred (portability priority), Windows compatibility considered if necessary
- Streaming Software: OBS to be used
2. Non-Negotiable Requirements (Must Have)
2-1. Technical Requirements
Face Replacement Specifications:
- Replace only eyes and eyebrows
- Use original parts for nose down (mouth/lips)
- Reason: To prevent double lips when drinking liquids
Safety:
- Face processing must never drop out while the face is visible on camera
- Fail-safe function (e.g., stopping video) if face risks leaving the frame
Quality:
- Face and mouth movements must match perfectly
- No unnaturalness even at close range
OBS Integration:
- Compatible with OBS (via virtual camera, etc.)
2. Nice to Have
Voice Changer Integration:
- Compatibility with externally contracted voice changers
- Open to considering other proposals
Skin Smoothing Filter:
- Apply skin smoothing filter to nose and mouth (user's facial features)
3. Technical Prerequisites
Regarding Latency:
- Current system has ~10-second delay
- Streaming delay is acceptable (delay until reaching viewers)
- However, misalignment between face and mouth is unacceptable
Accuracy:
- Must appear natural even at close range
- It's acceptable if it's obvious it's AI
- However, the more natural it looks, the better
Face for filtering:
- AI images will be provided
4. Development Schedule (Proposal)
3/5 ~ 3/15:
- Demo version development and verification phase
- Budget: Approximately $50–100
3/16–3/31:
- Main development and implementation phase
- Budget: Approximately $200–300
4/1–4/15:
- Adjustment and final testing phase
- Budget: Approximately $100–200
4/16:
- Actual Operation Commences
5. Risks and Concerns
Technical Risks:
- Limitations of GPU processing power on Mac environments
- Balancing real-time processing and quality
- Natural processing of boundary areas around the mouth and eyes
Operational Risks:
- Stability during extended streaming sessions
- Adapting to changes in lighting
- Adapting to changes in camera angles
1. Project Overview
Purpose:
Development of real-time face replacement functionality aimed at protecting privacy and expanding expressive capabilities during streaming.
Users:
Exclusively for individual streamers.
Streaming Environment:
- Current: Mac mini (M4 chip, 16GB RAM)
- Future: Upgradeable to 32GB/64GB as needed
- OS: Mac preferred (portability priority), Windows compatibility considered if necessary
- Streaming Software: OBS to be used
2. Non-Negotiable Requirements (Must Have)
2-1. Technical Requirements
Face Replacement Specifications:
- Replace only eyes and eyebrows
- Use original parts for nose down (mouth/lips)
- Reason: To prevent double lips when drinking liquids
Safety:
- Face processing must never drop out while the face is visible on camera
- Fail-safe function (e.g., stopping video) if face risks leaving the frame
Quality:
- Face and mouth movements must match perfectly
- No unnaturalness even at close range
OBS Integration:
- Compatible with OBS (via virtual camera, etc.)
2. Nice to Have
Voice Changer Integration:
- Compatibility with externally contracted voice changers
- Open to considering other proposals
Skin Smoothing Filter:
- Apply skin smoothing filter to nose and mouth (user's facial features)
3. Technical Prerequisites
Regarding Latency:
- Current system has ~10-second delay
- Streaming delay is acceptable (delay until reaching viewers)
- However, misalignment between face and mouth is unacceptable
Accuracy:
- Must appear natural even at close range
- It's acceptable if it's obvious it's AI
- However, the more natural it looks, the better
Face for filtering:
- AI images will be provided
4. Development Schedule (Proposal)
3/5 ~ 3/15:
- Demo version development and verification phase
- Budget: Approximately $50–100
3/16–3/31:
- Main development and implementation phase
- Budget: Approximately $200–300
4/1–4/15:
- Adjustment and final testing phase
- Budget: Approximately $100–200
4/16:
- Actual Operation Commences
5. Risks and Concerns
Technical Risks:
- Limitations of GPU processing power on Mac environments
- Balancing real-time processing and quality
- Natural processing of boundary areas around the mouth and eyes
Operational Risks:
- Stability during extended streaming sessions
- Adapting to changes in lighting
- Adapting to changes in camera angles