Hive Metastore Backup to S3 Script
I'm looking for a skilled freelancer to create a Spark script that transfers data from a Hive metastore to an S3 bucket. The goal of this project is to enable b...
Read more
ID / Date
Listing
Link
Pyspark Data Cleaning and Sorting
This vital task entails cleaning and sorting two CSV files of approximately 100,000 rows and second one of about 1.5million rows using pyspark (Python) in Jupyt...
Read moreAWS Data Engineering for Transformation
As a business, we are planning to use multiple Amazon Web Services such as Redshift, S3, Glue, RDS, Athena, Lambda, EC2, and EMR for our upcoming data engineeri...
Read moreSkilled Data Engineer for ETL Optimization
I'm seeking an experienced Data Engineer with proficiency in SQL and PySpark. Key Responsibilities: - Develop and optimize our ETL processes. - Enhance our data...
Read moreFull Python to PySpark Code Conversion
- Conversion of the entire Python code into PySpark. Skills and experience required: - Proficient knowledge in Python.
Read moreDatabricks SQL Code Development
I'm on the hunt for a highly skilled SQL programmer with an intermediate level of understanding to help develop a tailored SQL code using Databricks SQL. Note:...
Read moreAdvanced Azure Pyspark Skill Enhancements - who has existing project to show while teaching.
I'm beginer user of Azure Databricks and Pyspark. I'm looking to boost my skills to the next level and need an expert to guide me through advanced techniques. I...
Read moreData engineer with Airflow, SQL and PySpark skills
Looking for someone with good skills in Airflow, Pyspark and SQL.
Read moreRapid Pyspark Data Analysis in Python
I urgently need a Python program using Pyspark to assist in the comprehensive analysis of large datasets. The input data I will have is dataframe. I either need...
Read moreCatboost Distributed Training Optimization
I am looking for an expert in Python and Catboost to help me implement Distributed training. The main objective is to reduce the time spent in training large da...
Read moreDatabricks Unsupervised Learning Model
I'm seeking a proficient data scientist to develop an unsupervised learning algorithm in Databricks. The primary aim of this project comprises three-fold: data...
Read morePyspark code debugging
I need a skilled Databricks Data Engineer to have an extra pair of eyes on my code base and assist to debug the error I am getting. This task will be conducted...
Read moreAzure Synapse Integration with Data Explorer
I'm seeking a data engineer to successfully link my Azure Data Explorer with Azure Synapse. - The freelancer should have strong skills in creating data pipeline...
Read morePython-Based Table Validation
I require a Pyspark programmer to assist in reading and validating tables in a database. I need to ensure the columns in each table also exist in another source...
Read morePySpark Dataframe Transformation to JSON
I'm looking for a professional with a strong understanding of PySpark to help transform a dataframe into JSON following a specific schema. This project's main t...
Read moreC# and python developer
C# and Python Developer Needed We are seeking a skilled C# and Python/pyspark developer to assist us with debugging a console app. Skills and Experience Require...
Read morePyspark Data Push to Elasticsearch -- 2
I have an Excel file teeming with a million records that need to be pushed swiftly to Elasticsearch using Pyspark. Your expertise will help push all data column...
Read morePyspark data engineering training
I am a beginner/intermediate in Pyspark and I am looking for a training program that focuses on data processing. I prefer one on one and written guides as the f...
Read morePyspark data engineering training
Project Title: Pyspark Data Engineering Training Overview: I am a beginner/intermediate in Pyspark and I am looking for a training program that focuses on data...
Read moreNeed a senior C#/.Net Software engineer with exposure in Service Bus and/or EventHub
I am in need of a senior C#/.Net Software engineer who has extensive experience with Service Bus and/or EventHub. The objective of the project is to enhance an...
Read more1. Big Data Analytics report (approximately 3,000 words, with a tolerance of ± 10%) in the HTML format (60%) 2. Presentation (40%) - In the re-sit, the overall mark is based solely on the report:
I am looking for a freelancer who can help me with a Big Data Analytics project. The project involves creating a report and a presentation on the topic of data...
Read moreBrain and Lung Cancer using CNN by pyspark
I am looking for a skilled and experienced developer to work on a personal project involving the use of CNN by pyspark for analyzing brain and lung cancer. Skil...
Read moresynapse pyspark delta lake merge scd type2 without primary key
I am looking for a skilled professional who can help me with a project titled "synapse pyspark delta lake merge scd type2 without primary key". The ideal candid...
Read moreResolve aws glue job error
I have created one aws glue job but its failing with error ModuleNotFoundError: No module named 'psycopg2' when redshift connection is added to the Gluejob When...
Read moreLooking for Airflow, GCP and Python Expert
I am looking for an Airflow, GCP, and Python expert to assist me with my project. Candidate should have a good knowledge of DAG, GIT, pandas, agile, pyspark and...
Read morePyspark AWS ML Django
I am looking for a freelancer who can assist me with a Pyspark AWS ML project. The main goal of the project is data processing and transformation. I already hav...
Read moreFix existing code for anomaly detection python
I have a cloud-based system named qubole with a python code (2 existing codes), for anomaly detection which I need to be fixed urgently. The first code has perf...
Read moreApache airflow expert needed.
I am looking for an Apache Airflow expert who can help me with creating and managing workflows. Skills and experience needed: - Proficiency in Apache Airflow -...
Read moreI am trying for a azure data engineer role. I need real time project end to end display and explanation with lakehouse architecture.
I am looking for a project that can help me showcase my skills as an Azure data engineer. I am specifically interested in working on a project that incorporates...
Read morePython, Spark, Airflow, SQL and GCP Data engineer required
Looking for someone who has a good knowledge of Pyspark, Airflow DAGs, GitHub, Pandas and Agile Framework. Overall candidate should be well aware of the data in...
Read moreAnalysis of data using Pyspark and Koalas API. Random Forest Model
Its a simple dataset and I have already analysed it using pandas. I want to analyse it using Pyspark and Koalas API.
Read morePyspark traning
Project Description: I am looking for a PySpark trainer who has advanced experience and expertise in data processing. The ideal candidate should be able to prov...
Read moreDatabricks engineer
I am looking for a databricks engineer to optimize the cloud computing environment hosted on Azure Databricks. The project requires an understanding of data mod...
Read moreData analytics trainer
We are looking for a trainer who would teach students PYTHON,SQL,POWERBI its a 60day batch and you would train everyday. (2hr for 4 days a week) we are actively...
Read moreData Engineer
I am looking for a data engineer with expertise in Python, SQL, and data visualization. The ideal candidate will be able to work with structured data and have e...
Read morequery in pyspark
I am looking for a freelancer who can help me with a data analysis project using PySpark. I have a specific dataset that I would like to query, which is of medi...
Read moreWanted Azure DataEngineer
I am looking for an experienced Azure Data Engineer to work on my project specifically only from Hyderabad , India Specific Data Engineering Tasks: - Yes, I hav...
Read moreA python script which process a huge log file and extract the required data and insert in the db
Hello, I am looking for a Python developer who can help me with a log file processing and data extraction project. The log file is currently in the form of a te...
Read moreDesign aws etl architecture
Need a design architecture for the following use case. Data sources are mysql db and dynamo db, this data should be transformed and loaded into a target mysql d...
Read moreDevelop Pipeline in Spark to Insert/Update into Neo4j
I am looking for a developer with experience in Spark and Neo4j to develop a pipeline for inserting/updating data into Neo4j. The project requirements are as fo...
Read more