Blue Collar AI-Based Simulation Skill Assessment Platform with Integration to ATS

We are building a mobile-first SaaS platform that allows skilled trade workers (e.g., plumbers, electricians, welders, CMC operators, conveyor belt technicians) to complete role-specific assessments through video recordings, interactive simulations, and quizzes. Recruiters / employers will be able to review candidate performance via video, AI-generated scorecards, and reports. Employers will also have the ability to create or customize simulations using a drag-and-drop admin tool (Simulate IDE).

The purpose of the platform is to assess and qualify skilled workers for job opportunities globally in manufacturing, logistics, infrastructure, mining, and other technical industries.

⸻

Target Users: for Super Admin
1. Candidates – Skilled workers completing the assessments using mobile phones
2. Recruiters/Admins – Manage candidate pool and assign assessments
3. Employers/Clients – Build and assign simulations, view candidates and scores

⸻

Functional Requirements:

Candidate Portal (Mobile-Optimized Web Interface)
• Mobile browser access (no app download required)
• Candidates can launch the platform via WhatsApp, SMS, or QR code
• Candidate onboarding form: name, phone number, job role, experience
• Document upload: trade certificate, photo ID, and resume
• Record video tasks using mobile camera
• Complete interactive 2D simulations (drag-drop, tap, order steps)
• Answer role-specific multiple-choice and safety quizzes
• Support for multilingual interface (English required, Hindi and Spanish optional)
• Post-assessment view of results (score, status, feedback)

⸻

Simulation Types to Support

Role Example Assessment
Plumber Record pipe fitting, leak testing demonstration
Electrician Drag-to-complete wiring diagram, record switch demo
Welder Upload welding bead video, answer torch angle MCQ
HVAC Technician Simulate AC unit service steps, checklist review
CMC Operator Record panel operation video, step sequence task
Conveyor Belt Technician Interactive belt tension setting and roller alignment
Assembly Worker Tap-to-place task sequence simulation


⸻

Admin Dashboard (Recruiter/Admin Side)
• Dashboard for managing candidates, videos, scorecards, and feedback
• Bulk upload or invite candidates
• View candidate profile with uploaded documents
• Filter candidates by job role, skill score, location, experience
• Export candidate data (CSV, PDF)

⸻

Simulate IDE (Simulation Builder for Employers)
• Drag-and-drop interface to create new simulations
• Define:
• Simulation title and description
• Instructions and media type (video, quiz, 2D interaction)
• Checklist items, red flags, scoring weights
• Support for:
• Step-by-step process simulations
• Time-limited tasks
• Media attachment per step
• Preview simulation before publishing
• Assign simulation to job roles or specific candidates
• Save and reuse assessments across clients

⸻

Tech Stack

Frontend (Web + Mobile Optimized)
• React.js or Next.js for application and admin interface
• Tailwind CSS for mobile-responsive UI
• MediaRecorder API for mobile video/audio capture
• HTML5 Canvas or Framer Motion for 2D simulations
• React DnD or Blockly for drag-and-drop simulation builder
• React-i18next for multilingual support

⸻

Backend and APIs
• Node.js + Express for APIs and session management
• Python + FastAPI for video analysis, scoring logic, and AI services
• MongoDB Atlas or Firebase Firestore for storing users, assessments, scores
• AWS Lambda or Firebase Functions for background scoring and automation
• JWT-based session and user management

⸻

AI/ML & Simulation Evaluation
• OpenCV for analyzing video frames and tool movement
• Mediapipe or PoseNet for detecting posture and hand position
• TensorFlow.js for in-browser model execution (optional)
• Whisper (OpenAI) or Google Speech-to-Text for voice instruction analysis
• Custom rule-based engine for checklist matching, red flags, score calculation
• Scoring engine configurable by role and employer

⸻

Storage & Hosting
• AWS S3 or Firebase Storage for storing candidate video submissions and documents
• Vercel or Netlify for frontend hosting and CI/CD
• Cloudflare for CDN, SSL, and performance optimization
• Mux or Cloudinary for video processing, compression, and playback

⸻

Security and Compliance
• HTTPS encryption for all sessions
• Link or OTP-based login for ease of access
• JWT token handling for session control
• GDPR and data privacy compliant consent for media capture
• Encrypted media storage and access tokens

⸻

Required Features if missed
• Offline video recording with auto-upload when back online
• QR code launcher for field sourcing or hiring events
• Role library or JD parser to auto-generate simulations
• Admin dashboard with analytics (score averages, completion rates, etc.)
• Employer portal with filtered candidate views
• Resume + video CV combination display
• Learning mode: retry simulation with structured feedback
• ATS integration (Zoho Recruit, Workable, etc.)
• Admin permission roles (admin, recruiter, client)

⸻

Deliverables
• Fully functional web application (mobile-first design)
• Admin dashboard with recruiter and employer access
• Candidate assessment system with AI scoring engine
• Simulate IDE with drag-and-drop simulation builder
• Role-based simulation library (seed with 10-15 roles)
• Video upload, scoring, and playback features
• Cloud deployment and database configuration
• Multilingual-ready frontend
• Full source code with documentation

⸻

Timeline

• Complete Platform Pilot Launch: 90 days
• Ongoing bug fixes
• support post-launch (optional retainer phase)

⸻

What to Submit (Freelancer)

Please include:
1. Your portfolio or GitHub showing similar projects
2. Confirmation of experience with React, Node, Python (FastAPI), or similar stack
3. Time and cost estimate for MVP and full build
4. Any questions, suggested improvements, or risks

⸻