Real-Time Data Processing & AI Development
Budget: €36 – €0 EUR
We are looking for a highly skilled freelance developer with expertise in real-time data processing and machine learning/AI applications. The ideal candidate will design and implement a system that generates data-driven advice and automated decisions based on historical data and real-time inputs.
Project Details
The real-time data is already available and stored in PostgreSQL.
The system needs to efficiently process this data, apply machine learning models, and deliver actionable insights in real time.
The project is ongoing, requiring a professional with a long-term vision.
Key Responsibilities
✔️ Design, develop, and optimize real-time data pipelines.
✔️ Implement and train machine learning models for decision-making and recommendations.
✔️ Integrate models with streaming data sources (Kafka, RabbitMQ, etc.).
✔️ Set up and manage virtual machines or cloud infrastructure (AWS, GCP, Azure).
✔️ Ensure high scalability, efficiency, and low-latency in processing.
✔️ Optimize PostgreSQL queries for real-time analytics.
✔️ Maintain and improve the system based on new data and business requirements.
Required Skills & Experience
✅ 5+ years of experience in software development, data engineering, or ML/AI.
✅ Strong expertise in Python and relevant ML frameworks (TensorFlow, PyTorch, Scikit-learn).
✅ Experience with real-time data processing frameworks (Apache Kafka, Apache Flink, Spark Streaming, Dask).
✅ Strong understanding of PostgreSQL and database optimization for real-time data.
✅ Proficiency in Docker, Kubernetes, and cloud computing (AWS, GCP, or Azure).
✅ Ability to design and set up virtual machines and deploy scalable applications.
✅ Familiarity with APIs and microservices architecture.
✅ Strong analytical mindset and experience in AI-driven decision-making systems.
Nice to Have
➕ Experience with Feature Stores like Feast.
➕ Knowledge of MLOps and CI/CD for ML models.
➕ Background in predictive analytics, recommendation engines, or anomaly detection.
Project Duration & Commitment
? Ongoing freelance project with potential for long-term collaboration.
? Flexible working hours, but must ensure timely updates and progress.
Project Details
The real-time data is already available and stored in PostgreSQL.
The system needs to efficiently process this data, apply machine learning models, and deliver actionable insights in real time.
The project is ongoing, requiring a professional with a long-term vision.
Key Responsibilities
✔️ Design, develop, and optimize real-time data pipelines.
✔️ Implement and train machine learning models for decision-making and recommendations.
✔️ Integrate models with streaming data sources (Kafka, RabbitMQ, etc.).
✔️ Set up and manage virtual machines or cloud infrastructure (AWS, GCP, Azure).
✔️ Ensure high scalability, efficiency, and low-latency in processing.
✔️ Optimize PostgreSQL queries for real-time analytics.
✔️ Maintain and improve the system based on new data and business requirements.
Required Skills & Experience
✅ 5+ years of experience in software development, data engineering, or ML/AI.
✅ Strong expertise in Python and relevant ML frameworks (TensorFlow, PyTorch, Scikit-learn).
✅ Experience with real-time data processing frameworks (Apache Kafka, Apache Flink, Spark Streaming, Dask).
✅ Strong understanding of PostgreSQL and database optimization for real-time data.
✅ Proficiency in Docker, Kubernetes, and cloud computing (AWS, GCP, or Azure).
✅ Ability to design and set up virtual machines and deploy scalable applications.
✅ Familiarity with APIs and microservices architecture.
✅ Strong analytical mindset and experience in AI-driven decision-making systems.
Nice to Have
➕ Experience with Feature Stores like Feast.
➕ Knowledge of MLOps and CI/CD for ML models.
➕ Background in predictive analytics, recommendation engines, or anomaly detection.
Project Duration & Commitment
? Ongoing freelance project with potential for long-term collaboration.
? Flexible working hours, but must ensure timely updates and progress.