Hololens MR Surgical Training App

I am building a mixed-reality application for Microsoft Hololens that lets medical students rehearse key anesthesia tasks inside a simulated operating-theatre environment. The focus is surgical-procedure training, so every interaction—from patient positioning to airway management and real-time vital monitoring—must feel clinically authentic, responsive to hand-tracking and voice commands, and capable of recording performance metrics for later review.

Core workflow
• A student activates the scenario, follows on-device prompts, selects the desired anesthesia protocol, and completes each step under timed or guidance modes.
• Contextual 3-D overlays illustrate anatomy, instrument placement, drug dosage indicators, and safety alerts as the case progresses.
• When all stages finish, the system generates a performance summary with pass/fail thresholds and data export to CSV or JSON for faculty analysis.

Deliverables
• Fully compiled Hololens 2 build (.appx) ready for sideloading
• Source project with organised assets and clean, commented code
• Quick-start document covering setup, controls, and how to add new surgical scenarios in the future
• Brief video capture (≈2 min) demonstrating the experience end-to-end

Acceptance criteria
✔ Stable 60 fps on Hololens 2 without frame drops
✔ Accurate hit-testing for hand and gaze inputs during instrument manipulation
✔ Voice command recognition for at least ten common OR phrases (e.g., “increase propofol”, “check vitals”)
✔ Performance log correctly records timestamps, errors, and completion status

Unity and MRTK are the expected toolset, but I am open to suggestions if you have a proven alternative compatible with Hololens. Expansion to additional specialties such as orthopedics or cardiovascular surgery is planned, so please keep the architecture modular and easy to extend.

Timeline and milestones are negotiable once we review your proposed approach and any relevant demo work.