n8n + Pinecone Optimization Expert for AI Music Generation Platform

Job ID: 39595229

Budget: €1,500 – €3,000 EUR

I'm developing WhatsApp Songs, an innovative platform that transforms WhatsApp chat exports into personalized AI-generated music. The system analyzes conversations for emotions and themes, creating unique songs that capture relationship essence.

Technical Challenge:
Our n8n workflow experiences significant performance issues with large WhatsApp chats:
- Small chats (<500 messages): 3 minutes
- Medium chats (2k messages): 12 minutes
- Large chats (>5k messages): timeout

The bottleneck occurs at the Pinecone Vector Store node during embedding upserts.

Current Tech Stack:
n8n Cloud (workflow automation)
Pinecone (paid tier) for vector storage
Anthropic Claude for emotion/theme analysis
MusicAPI.ai for song generation
Webhook → Parse → Embeddings → Pinecone → AI Analysis → Music Generation

Required Skills:
Strong experience with n8n workflow optimization
Proven expertise with Pinecone vector databases
Understanding of embedding generation and chunking strategies
Experience handling large-scale data processing
Knowledge of n8n Cloud execution limits and workarounds

Deliverables:
Optimize Pinecone upsert performance for 5k+ message chats
Implement efficient chunking strategy for large conversations
Reduce processing time to under 5 minutes for large chats
Document optimization approach and best practices
Ensure scalability for future growth

Nice to Have:
Experience with WhatsApp chat parsing
Background in NLP/sentiment analysis
Previous work with music generation APIs
Interest in AI-powered creative applications

Project Type: Fixed price or hourly (open to discussion)

Budget: $1500-$2000 (negotiable based on experience and solution quality)

Timeline: Looking to start immediately, completion within 1-2 weeks

Additional Opportunity:
For exceptional candidates who demonstrate both technical excellence and genuine interest in the project vision, there's potential for ongoing collaboration or technical co-founder consideration in this bootstrapped venture.

Please include in your proposal:
Relevant experience with n8n and Pinecone
Your approach to solving this optimization challenge
Examples of similar performance improvements you've achieved
Estimated timeline and cost

Looking forward to working with someone who finds this technical challenge as exciting as the creative possibilities it enables!
Related categories: Data Processing JSON NLP AI Development AI Agents n8n