Spark projects — HireLancer archive

ID / Date Listing

Home-Based Scala Spark Data Processing Expert

I'm seeking a Scala Spark developer who can come to my home and assist with various data processing tasks. Key Responsibilities: - Data Cleaning: Ensuring that...

HL-38959509

Exploratory data analysis inJupiter

I am looking for someone who can do Exploratory data analysis in Jupiter notebook in spark

HL-38937847

Cybersecurity Tool Development for Research -- 2

I'm seeking an experienced developer to create a sophisticated cybersecurity tool tailored for threat modeling and detection, intended for a research paper. Key...

HL-38928632

AWS Glue: Incremental Fetch from BigQuery and Store on S3

Seeking an AWS Glue expert to assist with fetching analytical data from Google BigQuery and storing it on S3 in Parquet or CSV format. The job includes setting...

HL-38908774

Spark Messaging Migration to New Windows Server

I need an experienced professional to help me migrate my Spark messaging implementation from an old server to a new Windows server. Old server is running the in...

HL-38799100

Interviewer Needed for Big Data Developer

I'm seeking a seasoned interviewer with a strong focus on Big Data technologies, specifically Hadoop. The purpose of this role is to assess candidates for mid-l...

HL-38789272

Hadoop Cluster Simulation on 4 Ubuntu VMs

I'm in need of a professional who can set up and simulate a Hadoop cluster consisting of 4 Ubuntu virtual machines. This cluster needs to be equipped with Hive,...

HL-38754781

Code Optimization for Java, Scala & Spark

I'm seeking a seasoned coder with extensive knowledge in Java, Scala, and Spark to enhance the maintainability of my existing codebase. Ideal Skills: - Proficie...

HL-38746799

Install and Setup Apache Spark MLlib on Linux Ubuntu

I need an expert to set up Apache Spark MLlib on my local Linux Ubuntu server. TASK: once you are hired, you will need to install and setup Apache Spark MLlib o...

HL-38706308

Apache Spark Assignment

Link to task (ONLY TASK 1 required): https://hackmd.io/@pesu-bigdata/ryDbjmTkke#Task-1---Spark This document contains 2 tasks : Task 1 : This task is to be solv...

HL-38700376

Big Data Developer with Spark and Pytoch for creating Recommendations Engine

*Job Title: Big Data Developer* *Job Description:* We are seeking a skilled Big Data Developer to join our team and work on generating daily job recommendations...

HL-38632025

Demand Side Platform Development

I'm looking for a skilled professional with extensive experience in developing a demand-side platform (DSP). If you are confide about DSP development, feel free...

HL-38613089

Big Data Analysis with Talend, Spark, Scala

I need a skilled data professional to help me analyze structured data using Talend, Spark, and Scala. Key Responsibilities: - Utilizing Talend for data integrat...

HL-38601530

Virtual Try-On for Dresses & Outfits - 22/09/2024 02:53 EDT

I'm looking to enhance my store's customer experience through a Fashion AR campaign. This project involves creating a Virtual Try-On experience for dresses and...

HL-38588113

Azure Synapse Analytics Spark Monitoring

I'm in need of an Azure Cloud Engineer with proven expertise in Azure Synapse Analytics and Spark monitoring. The primary focus of this role is on big data anal...

HL-38559619

Instagram AR Filter with Logo

I'm seeking a professional who can create an Instagram Augmented Reality filter for my brand. The filter will need to have my company logo and toll-free number...

HL-38535720

Quantexa Assessment with Spark and Scala -- 2

I'm in need of assistance with a Quantexa assessment that involves writing new Scala code integrated with Spark. Key Responsibilities: - Utilize Spark and Scala...

HL-38485978

Azure ML Serverless Spark Expert Needed

I'm seeking an Azure specialist to assist with machine learning model training using Azure ML Studio’s Serverless Spark Compute. Key Responsibilities: - Utilize...

HL-38439475

Looking for Freelancer : Final Year Student with in Data Engineering & ML Experience

I’m looking for a final-year Computer Science or relevant student to help me with some tasks related to Data Engineering and Machine Learning. Ideally, you shou...

HL-38430654

Need Data engineer with Spark and OOPS experience. It's a part-time opportunity 2hrs per day payment will be accordingly 25-30k per month

HL-38391997

Experienced Data Engineer with Strong Pyspark, Celery, Redis, Docker and Kubernetes Skills

I'm seeking an experienced Data Engineer who can explain and share the source code of any past project developed using Pyspark, Celery, Redis, Docker, and Kuber...

HL-38388745

JSON Processing and Delta Table Mapping

I'm in need of a data engineer with strong skills in JSON parsing and Delta Lake. The task involves reading from an Azure Event Hub, traversing through a 4-5 le...

HL-38315009

Scala Developer for Project

I'm in search of a skilled Scala Developer to assist with a project. While the specific tasks and scope of work can be discussed in more detail, I'm ideally loo...

HL-31354528

Scala/Spark Programming

This is an ongoing project requires hands-on expertise in scala programming. It consists of a set of tasks to complete with unit testing for each task. Knowledg...

HL-38254953

JSON Data Transformation with Scala

I'm in need of assistance to create a task that makes use of AWS S3, Lambda, and Scala code to process JSON data. Here are the details: • Main Task: The vital o...

HL-38231466

AWS Data Engineer for GPT Training

I'm in need of a seasoned data engineer with a senior-level experience, particularly on AWS. Your role will encompass: - Detailed Project Explanation: You will...

HL-38180497

Apache Airflow Enhancement Project

I'm looking for an intermediate-level Airflow developer to assist with several tasks on my project. This includes: - Writing Directed Acyclic Graphs (DAGs). - I...

HL-38173639

Java Apache Spark MLlib Tutor Needed

I'm in search of a talented and experienced Apache Spark MLlib tutor to aid me in my learning journey. If you're an expert in Apache Spark MLlib with a passion...

HL-38158054

Azure Python Developer for Automation

I'm seeking a skilled Python developer with a strong background in Azure for a time-sensitive project that includes multiple facets. Key Responsibilities: - Azu...

HL-38143754

ETL Processing with Python and PySpark

I'm in need of an experienced Python and PySpark developer with a solid background in Azure. The main task will be ETL processing. The ideal candidate will be a...

HL-38140180

Programming with Scala, Hive, Spark

I'm looking for a skilled programmer with robust knowledge of Scala, Hive and Spark to work on a data-related project. Key Points: - The project focuses on codi...

HL-38140709

New Scala Program Development with Spark

I am looking for a skilled Scala programmer to assist me in developing a new Scala program. This task involves writing code from scratch, with the specific focu...

HL-38136435

NLP Engineer for Resume Parsing

We are seeking an experienced NLP Engineer to develop a robust resume parsing solution for our website. The ideal candidate will have a strong background in Nat...

HL-38123459

Install Hadoop and hive on Ubuntu+ integration with spark

I have a Ubuntu 22.04 server, currently with spark running perfectly. I want, however, integrate spark with Hive warehouse. In this project, you're required to...

HL-38090763

Databricks Data Engineer day to day usage Walkthrough

Day to day expert Walkthrough of Databricks usage tips and techniques

HL-38029405

Spark Script for Hive to S3 Data Migration

Create a Spark script to transfer metastore data from Hive to S3 - Create a connection to Hive metastore - Fetch schema.table definition for the database - Crea...

HL-37994687

Hadoop/Spark Developer

I am in urgent need of Hadoop/Spark developer who is proficient in both Scala and Python for a data processing task. I have a huge volume of unstructured data t...

HL-37988192

Optimize Search and Integrate Data

I'm seeking an expert in LucidWorks Fusion to enhance my project by optimizing website search and integrating it with multiple data sources. Here are the main t...

HL-37985935

Teach me Scala Problems to Solve ( Graphs Maps )

Help me in solving scala leetcode problems of data structures.

HL-37967931

Event-B Modelling & Spark Expertz

I am seeking an experienced professional who is proficient in both Event-B modelling and Spark. If you've worked on similar projects, it would be beneficial. A...