Develop SNAP Image Recognition Feature

Job ID: 39678027

Budget: $750 – $1,500 USD

We are Crateble, a platform dedicated to helping users track and manage the value of their collectible items, including Trading Card Games (TCGs), comics, video games, and more. We are seeking a skilled developer to create an innovative image recognition feature, SNAP, using the Gemini Vision API.

Key Requirements:
- Develop a feature that supports both photo captures and uploads for identifying collectible items.
- Integrate the Gemini Vision API to match images with our product database.
- Provide a user-friendly interface for selecting matched items or guiding users through a "Create New Product" flow with AI-generated suggestions when no match is found.
- Allow users to add items to their portfolio using the same photo, including additional details such as condition, price, and notes.
- Ensure a balanced approach between accurate image matching and faster image processing.

Technical Stack:
- Backend: NestJS, PostgreSQL, Prisma
- Frontend: NextJS, Redux, TailwindCSS

Ideal Skills and Experience:
- Proficiency in using Gemini Vision API or similar image recognition technologies.
- Experience with full-stack development, particularly with NestJS and NextJS.
- Familiarity with Redux for state management and TailwindCSS for styling.
- Ability to integrate new features into existing systems seamlessly.
- Strong problem-solving skills and attention to detail.

We will provide Figma designs to guide the development process. If you have the expertise to bring this feature to life and enhance our platform's capabilities, we would love to hear from you!

Additional Details:

AI / API Requirements:
• Use Gemini API (Google) for:
• Product recognition
• Extracting structured data (brand, product name, category)
• Confidence scoring or reasoning
• Fallback or optional: OpenAI Vision API
• Accuracy and speed are important.
• Must support both mobile and desktop image inputs.

Technical Requirements:
• Must support:
• Image preview & compression
• Loader while scanning
• AI match result (select or create)
• Autofill product creation form
• Add item to portfolio using selected image
• Support clean modular implementation and documentation.Frontend SNAP Flow (already designed, dev-ready):
1. User clicks “+ Add Product”
2. Two tabs:
• [SNAP] (default)
• [Search]
3. SNAP Tab Flow:
• Upload/take photo → loader → AI identifies product
• Display results in product card grid
• User selects a match or creates a new product
4. If new product is created → prefill from AI data → user edits/approves
5. Continue to Add Item to Portfolio flow

Deliverables:
• Fully working SNAP feature integrated into our web platform
• Gemini API integration & fallback option
• Support for:
• Match Found
• No Match Found
• Prefill product creation
• Add item flow
• Clean, modular code and API endpoints
• Documentation for setup & future maintenance