Apache Spark projects — HireLancer archive

ID / Date Listing

Experienced Data Engineer Needed

# Data Engineer – Remote Contract We are looking for an experienced Data Engineer to join a remote technical project supporting an international client. * It is...

HL-40623103

Big Data Technical Interview Specialist (Spark/Scala, Hadoop, Hive)

I’m assembling a short-term roster of interviewers who can rigorously assess candidates for senior-level Big Data roles, with a sharp focus on Apache Spark. You...

HL-40609649

Custom Data Pipeline Engineering

I have an in-house project that needs a fully custom-built data pipeline. The goal is to ingest Parquet files arriving in our file system, apply the required tr...

HL-40607034

Custom Data Pipeline Engineering

I have an in-house project that needs a fully custom-built data pipeline. The goal is to ingest Parquet files arriving in our file system, apply the required tr...

HL-40596563

Senior Data Engineer for Analytics

I need an experienced data engineer who can turn a steady stream of semi-structured information into reliable, analysis-ready datasets. The ultimate goal is dat...

HL-40593384

Data Science & Data Engineering Corporate Trainer Required (Classroom Training)

We are looking for an experienced corporate trainer to deliver Classroom Training on Data Science and Data Engineering for a corporate client. Training Details:...

HL-40567045

Apache Spark a Spring Batch

Necesito apoyo para completar un flujo Apache Spark que arranca con descargas de archivos de texto y termina en un archivo listo para ser consumido por un job d...

HL-40559358

Databricks Architect – Cost Optimization & Agentic AI/ML (DBRX, Agent Bricks, Lakehouse)

Description: Need an experienced Databricks professional to design, build, and optimize an end-to-end Lakehouse platform covering data science, ML engineering,...

HL-40526215

Java Kafka EMR Hadoop Data Specialist

I’m building a data-processing and analytics platform on AWS EMR that pulls events from Kafka, lands them in Hadoop, and serves refined datasets to downstream t...

HL-40525324

Bantuan Proyek Big Data dan Optimalisasi Performa

Saya sedang mencari freelancer yang memiliki pengalaman kuat di bidang Big Data, Data Engineering, dan Performance Optimization untuk pendampingan sebuah proyek...

HL-40523186

Data Engineering Course Creation

About the project We (SCOPE, an EdTech platform) have a fully finalized 15-week Data Engineering curriculum and need an experienced data engineer to create the...

HL-40509362

Lead GCP Data engineer

Key Responsibilities: experience 14+Years ● Design, develop, test, and maintain scalable ETL data pipelines using Python. ● Architect the enterprise solutions w...

HL-40475926

Data Architects - 100% remote, ASAP, 12+ months

Dear Data Architects, We are currently looking for multiple Data Architects for one of the leading tech companies in Germany. The position is 100% remote and lo...

HL-40475934

Data Engineers - 100% remote, ASAP, 12+ months -- 2

Dear Data Engineers, We are currently looking for multiple Data Engineers for one of the leading tech companies in Germany. The position is 100% remote and long...

HL-40469891

Databricks Job Runtime Optimization - 26/05/2026 04:44 EDT

Our nightly Databricks notebook that ingests structured data from Azure Data Lake has crept from a consistent 3-hour finish to nearly 8 hours. The slowdown is c...

HL-40456573

Lead Data Engineer for Data Infrastructure

Hiring: Lead Data Engineer (Data Platforms & Analytics Infrastructure) Job ID: GKS2005_1 --- Role: Lead Data Engineer Mode: Remote (Monthly visit to Coimbatore...

HL-40442930

Data Lakehouse Architecture & Implementation

I’m looking for an experienced consultant who can take the lead in architecting and standing up a full-scale data lakehouse, with the immediate goal of seamless...

HL-40439678

Data Engineers - 100% remote, ASAP, 12+ months

Dear Data Engineers, We are currently looking for mutliple Data Engineers for one of the leading tech companies in Europe. The position is 100% remote and long-...

HL-40437204

Freelance Subject Matter Expert (SME) – Microsoft Certified: Azure Databricks Data Engineer Associate (Beta)

We are looking for a freelance Subject Matter Expert (SME) who has successfully cleared the Microsoft Certified: Azure Databricks Data Engineer Associate (beta)...

HL-40383978

Optimizar Descargas Spark para TXT

Trabajo con archivos .txt que pesan entre 1 GB y 10 GB y necesito acelerar su descarga y análisis en Apache Spark; después, esos datos se consultarán desde mis...

HL-40381335

Real-Time Flink Iceberg Spark Pipeline

We are seeking an experienced Data Engineer to build and maintain scalable, high-performance data pipelines and infrastructure for our next-generation data plat...

HL-40365795

Architect Payment Fraud Alert System

I need a clear, scalable architecture that can detect and instantly alert on unusual spending patterns in our payment flow. The focus is narrow and well-defined...

HL-40365867

Azure Data Engineer with AKS Experience Required

We are seeking a highly skilled Azure Data Engineer to design, develop, and maintain robust data solutions on the Azure platform. This role requires strong tech...

HL-40340121

Beginner PySpark Engineering Lessons

I am starting from scratch in data engineering and want a structured, hands-on learning path that begins with PySpark. Video-based instruction is my preferred f...

HL-40325643

Java Spark Data Pipeline Engineer

I need an experienced data engineer who can take full ownership of end-to-end pipeline work on GCP. The core stack is Java, Apache Spark, Google Cloud Storage a...

HL-40322337

Senior Data / AI Engineer role with Native English skill

Needs to hire 2 Freelancers Summary Job Overview: We are assembling a remote engineering team for startup projects serving US-based clients. We are currently lo...

HL-40313921

Lead Data Engineer (GCP) | 10–12 Years | Remote | Contract Role

Onboarding Requirement: A one-day physical visit to the Noida office is required for onboarding and laptop collection. Job Description: We are looking for an ex...

HL-40306939

Senior Data Engineer

I’m scaling a data-driven SaaS platform and need a senior-level data engineer who can jump straight into our production environment and make an immediate impact...

HL-40301277

Data engineer Interview preparation

I have an upcoming data-engineer interview and I’m looking for a seasoned professional who can step in as my proxy and help me to crack interview. My resume ski...

HL-40227186

PySpark & SQL Hadoop Specialist

I have a Hadoop cluster holding several large data sets, and I need a seasoned PySpark developer who also writes rock-solid SQL. The immediate aim is to connect...

HL-40182146

Automation of Daily Monitoring Tasks

Task 1 Description Identify areas of improvement in daily monitoring activities and implement automation to reduce manual effort. Identify automation opportunit...

HL-40153281

AWS Native Data Platform Build - Native AWS Data Engineer

I’m looking for a Data Engineer with strong AWS native services experience to help build and support an event-driven data platform. This project focuses on auto...

HL-40097144

Consolidate Scala Streaming Jobs Cluster

I currently run four independent Scala streaming jobs on four separate clusters. I’d like to cut that overhead and run all jobs on a single job cluster sourced...

HL-40086107

Asterisk IVR Specialist Needed

I need an experienced Asterisk programmer to setup and maintain a custom IVR for an Automated Third-Party Verification Service. Key tasks include: - Implementin...

HL-40058120

Databricks Analytics Training & Mentoring

I’m looking for an experienced Databricks practitioner who can spend time on providing overview and assign some tasks, and guide me. Here’s what I need: > A ove...

HL-39976712

Building Comprehensive Real-Time Data Pipeline

Real-Time Data Pipeline Project Overview This term project involves building an end-to-end data pipeline using big-data tools and streaming technologies. The sy...

HL-39969895

Spark Data Engineer Needed ASAP

I’m looking for a seasoned data engineer (ideally 4–13 years in the field) who can jump straight into an active project and get production-ready code running fa...

HL-39930192

Scalable Data Pipelines & Analytics Dashboards

The assignment covers three tightly-linked streams of work. First, I need end-to-end data pipelines and ETL workflows that ingest, transform, and load data at s...

HL-39907411

Data Engineer – PySpark, Python, AWS (US Work Support)

Job Title: Data Engineer – PySpark, Python, AWS (US Work Support) Experience: 10+ Years Budget: ₹35,000 – ₹40,000 per month Type: US Work Support Job Descriptio...

HL-39884255

Big Data Visualization Setup

I have a sizeable dataset and want to see it come to life through clear, interactive visuals. I’m flexible on the platform—Apache Hadoop, Apache Spark, Amazon R...