Data Engineer for Crypto Sentiment Analysis
Budget: €1,500 – €3,000 EUR
Project Name:
Data Engineer | ETL Pipelines & Sentiment Analysis for Crypto
Project Description:
We are looking for a Data Engineer to develop ETL pipelines and build a multi-language news scraper for sentiment analysis in the crypto market. The ideal candidate should have experience handling large datasets, optimizing storage solutions, and implementing efficient data pipelines.
Key Responsibilities:
• Create ETL pipelines for historical OHLCV + social media data.
• Develop a multi-language news scraper (20+ languages).
• Optimize vector database storage for efficient retrieval.
• Implement real-time streaming data processing.
Tech Stack:
• Data Processing: Apache Airflow, Apache Kafka, Spark
• Database: PostgreSQL, Pinecone (Vector DB)
• Cloud: AWS/GCP (certifications preferred)
• NLP Tools: spaCy, NLTK, Hugging Face Transformers
Requirements:
✅ Experience with big data ETL pipelines.
✅ Strong knowledge of real-time data ingestion & streaming.
✅ Prior experience with crypto data processing is a plus.
✅ Ability to maintain 99.9% uptime on data feeds.
Compensation:
? €1,500 - €3,000 total
? €200 bonus for delivering a labeled dataset of 50,000+ crypto-related text samples.
How to Apply:
• Send your GitHub/Portfolio.
• Email Subject: [DATA-ENGINEER] Application.
Skills:
Python, Airflow, Big Data, NLP, AWS
Data Engineer | ETL Pipelines & Sentiment Analysis for Crypto
Project Description:
We are looking for a Data Engineer to develop ETL pipelines and build a multi-language news scraper for sentiment analysis in the crypto market. The ideal candidate should have experience handling large datasets, optimizing storage solutions, and implementing efficient data pipelines.
Key Responsibilities:
• Create ETL pipelines for historical OHLCV + social media data.
• Develop a multi-language news scraper (20+ languages).
• Optimize vector database storage for efficient retrieval.
• Implement real-time streaming data processing.
Tech Stack:
• Data Processing: Apache Airflow, Apache Kafka, Spark
• Database: PostgreSQL, Pinecone (Vector DB)
• Cloud: AWS/GCP (certifications preferred)
• NLP Tools: spaCy, NLTK, Hugging Face Transformers
Requirements:
✅ Experience with big data ETL pipelines.
✅ Strong knowledge of real-time data ingestion & streaming.
✅ Prior experience with crypto data processing is a plus.
✅ Ability to maintain 99.9% uptime on data feeds.
Compensation:
? €1,500 - €3,000 total
? €200 bonus for delivering a labeled dataset of 50,000+ crypto-related text samples.
How to Apply:
• Send your GitHub/Portfolio.
• Email Subject: [DATA-ENGINEER] Application.
Skills:
Python, Airflow, Big Data, NLP, AWS