VSCode integration with Fabric
Hi, i have a cluster in Fabric but this interface is annoying to work, i was trying to connect VSCode with some extensions to fabric, and im able to see the wor...
Read more
ID / Date
Listing
Link
Pyspark Pro Needed For JSON Transformation
I'm seeking a seasoned PySpark developer to process a 250GB complex nested JSON file. The primary goal is data transformation, specifically flattening nested st...
Read moreSenior Data Engineer - 1 month contract (par-time) - India based
I'm looking for a Senior Data Engineer for a 3-month contract, working part-time(2/3 hrs per day). The primary focus of this role will be on data engineering wi...
Read moreSenior Data Engineer - 1 month contract (par-time) - India based
I'm looking for a Senior Data Engineer for a 3-month contract, working part-time(2/3 hrs per day). The primary focus of this role will be on data engineering wi...
Read moreAzure Databricks Data Engineer Needed
Hi, This is a job support role. Mostly you will be working for 2 hours on a daily basis with the developer on zoom call Please confirm following - Early morning...
Read moreDatabricks Code Performance Enhancement
I'm seeking an expert in Databricks code optimization to improve the speed of my data processing. The current bottleneck is primarily in the data transformation...
Read morePySpark Glue Job for S3 to Redshift
I'm looking for a skilled PySpark developer to create a Glue Job that connects daily to an S3 bucket. The job should handle 5 different types of CSV files, conv...
Read moreAzure Data Engineer Needed for ADF Enhancement
I'm seeking a seasoned Azure Data Engineer to augment our current Azure Data Factory (ADF) pipeline. This pipeline is responsible for processing data from an Az...
Read morePyspark Code for Dynamic Join Operations
I need a Pyspark code that reads join rules from a txt file and applies them in the main program. The joins will be based on multiple columns, with the rules fo...
Read moreExploratory data analysis inJupiter
I am looking for someone who can do Exploratory data analysis in Jupiter notebook in spark
Read moreE-commerce Data Analysis with Apache Spark
I'm looking for a freelancer who can process an e-commerce dataset using the Apache Spark ML API in a Jupyter notebook. The main aim of this project is to gener...
Read moreData Engineering Job Preparation
I'm seeking assistance to land a Data Engineering role. I specifically need help with technical interview questions and getting comfortable with addressing tech...
Read moreAWS Glue: Incremental Fetch from BigQuery and Store on S3
Seeking an AWS Glue expert to assist with fetching analytical data from Google BigQuery and storing it on S3 in Parquet or CSV format. The job includes setting...
Read moreData Warehouse Schema Creation for Redshift
I need a professional who can help me develop skills in data cleaning, transformation, and schema design by organizing raw, fragmented data into a cohesive and...
Read morePySpark Expert for Unsupervised Learning
I'm seeking a PySpark developer proficient in unsupervised machine learning, specifically in building recommender systems. Key Responsibilities: - Utilize PySpa...
Read moreData Engineering Interview Preparation
I'm seeking an experienced Data Engineer to guide me in preparing for an interview. With 5 years of Python development and 1 year as a Data Engineer, I'm keen t...
Read moreAWS Data Engineering Support Needed
I'm currently engaged in a data engineering project and I need assistance with data transformation and ETL tasks. A significant portion of this project involves...
Read moreData Engineer with Unity Catalog
I'm seeking a seasoned Data Engineer with over 7 years' experience, who can manage and govern our data using Unity Catalog. The engineer will need to seamlessly...
Read moreHadoop Cluster Simulation on 4 Ubuntu VMs
I'm in need of a professional who can set up and simulate a Hadoop cluster consisting of 4 Ubuntu virtual machines. This cluster needs to be equipped with Hive,...
Read moreAzure, Snowflake, Databricks Data engineer Job support role (Exp 10 + years)
Hi, This is a job support role. Mostly you will be working for 2 hours on a daily basis with the developer on zoom call Please confirm following - Early morning...
Read moreMigrate Airflow to Databricks
I'm looking for a professional who can help me migrate my existing Airflow setup to Databricks. I have 4 data workshops that need to be migrated as soon as poss...
Read moreInstall and Setup Apache Spark MLlib on Linux Ubuntu
I need an expert to set up Apache Spark MLlib on my local Linux Ubuntu server. TASK: once you are hired, you will need to install and setup Apache Spark MLlib o...
Read moreApache Spark Assignment
Link to task (ONLY TASK 1 required): https://hackmd.io/@pesu-bigdata/ryDbjmTkke#Task-1---Spark This document contains 2 tasks : Task 1 : This task is to be solv...
Read morePython & SAS Developer Needed
I'm looking for a skilled Python and SAS developer to join my team. This role involves working for 2 hours daily from Monday to Friday, with a compensation of 3...
Read moreBig Data Developer with Spark and Pytoch for creating Recommendations Engine
*Job Title: Big Data Developer* *Job Description:* We are seeking a skilled Big Data Developer to join our team and work on generating daily job recommendations...
Read moreSnowflake Data Warehouse Implementation
Implement a robust data warehousing solution on Snowflake to enable data-driven decision-making. Integrate data from SAP and other systems into a centralized Sn...
Read moreAI/ML Expert Needed for Model Deployment
I'm seeking a seasoned professional in AI/ML with deep expertise in developing and deploying Machine Learning models using TensorFlow. Experience with MLflow, L...
Read morePredictive Health Risk Model Using Lifestyle Data
The “Predictive Health Risk Model Using Lifestyle Data” project is aimed at assessing potential health hazards like Diabetes, Asthma, Arthritis and Heart Attack...
Read morePySpark Code Unit Testing for Quality
I'm in need of a professional with extensive PySpark unit testing experience. I have PySpark code that loads data from Oracle ODS to ECS (S3 bucket). The goal i...
Read morePySpark Developer for Kafka Streaming Program
I need an experienced Azure, PySpark, and Databricks developer to help me create a real-time analytics Kafka Streaming WordCount program using PySpark. Key Requ...
Read morePython Software Development Assistance
I'm seeking a technically savvy professional to provide support in the realm of software development, specifically with Python. Ideal Skills and Experience: - P...
Read moreDatabricks & Python Expert for Data Engineering
I'm seeking a seasoned professional in Databricks and Python, with experience in utilizing the Nexus repository. The primary focus of this project is data engin...
Read moreTeach me Data Engineering and make me job ready
I'm aiming to become job-ready in the Data Engineering sphere, with a primary concentration on Data Pipeline Development. I require a comprehensive training pro...
Read morePySpark Data Analysis and Transformation Task
I'm seeking a skilled PySpark expert to assist with data analysis and transformations on structured data. The task involves: - Utilizing PySpark to manipulate a...
Read moreParametrise Analysis Databricks Notebook for Multiple Clients -- 2
I need a Databricks Notebook expert to help me parameterize an analysis notebook. The notebook will be used to perform data analysis and KPI creation on data fr...
Read moreSpark Job Producing Incorrect Results or exiting with error code 1.
I'm facing an issue with my Spark job. The job runs, but it exits with an error. I'm processing structured data, specifically CSV and JSON files, from my local...
Read moreComprehensive IT Training Video Creation
I am looking for a professional to design a series of training videos for beginners on Python, SQL, Pyspark, ADF, Azure Data Bricks, and Snowflake. The primary...
Read moreComprehensive IT Training Video Creation -- 2
I am looking for a professional to design a series of training videos for beginners on Python, SQL, Pyspark, ADF, Azure Data Bricks, and Snowflake. The primary...
Read moreAWS Glue Job Development with PySpark
I need an AWS Glue job written in PySpark. The primary purpose of this job is transforming data stored in my S3 bucket Ideal Skills: - Proficient in PySpark and...
Read morePySpark Code Optimization for Performance
I have a PySpark code that requires optimization primarily for performance. Key requirements: - Enhancing code performance to handle large datasets efficiently....
Read more