Apache Pinot DB Data Retrieval
Create a python script to read data from Apache Pinot DB using pyspark ,needs to be completed in 2-3 days. Key Requirements: - Use Spark Version 3.5.1 or 3.5.0...
Read more
ID / Date
Listing
Link
Microsoft Fabric - ELT Data Pipeline Project
I am looking for a data engineer to help me build data engineering pipelines in Microsoft Fabric using the Medallion Architecture. The primary goal of these pip...
Read moreApache Pinot Data Extraction with Pyspark -- 2
Create a python script to read data from Apache Pinot DB using pyspark ,needs to be completed ASAP. Key Requirements: - Use Spark Version 3.5.1 or 3.5.0 - Use p...
Read moreApache Pinot Data Extraction with Pyspark -- 2
Create a python script to read data from Apache Pinot DB using pyspark ,needs to be completed ASAP. Key Requirements: - Use Spark Version 3.5.1 or 3.5.0 - Use p...
Read moreCloud Deployment: Airflow & Spark POC
I'm looking for an expert to help me deploy Airflow and Spark in the cloud, specifically on Azure using the Azure Kubernetes Service (AKS). The project involves...
Read moreAutomatización de Procesos en Databricks
Hola buenos días, La oferta solo está disponible para personas que sean de habla hispana y tengan dominio sobre la herramienta python en Databricks (ambos skill...
Read moreAzure Data Processing Pipeline Development
As a client, I'm seeking an experienced Azure Cloud Engineer with proven expertise in developing data processing pipelines. The primary goal of this project is...
Read moreAzure Data Factory Expert Needed(pyspark)
I'm in search of a Azure Data Factory expert who is well-versed in Delta tables, Parquet, and Dedicated SQL pool. As per the requirement, I have all the data an...
Read morePyspark Developer Needed for Cosine Similarity
I'm looking for a talented Pyspark Developer who has experience in working with large datasets and is well-versed in PySpark above version 3.0. The primary task...
Read morePyspark-Assisted Small-Scale Data Storage
Seeking an expert skilled in Pyspark, Big data, PostGre SQL, Docker, and Hadoop, for a data storage project. - Objective: The core aim is to facilitate efficien...
Read moreData Validation Automation with Pytest
I'm in urgent need of a seasoned Python developer who's skilled in automation scripts using Pytest. Key Project Details: - I require an automation script that c...
Read moreExpert PySpark Developer for AWS Data Processing - 11/07/2024 02:55 EDT
I'm looking for an expert PySpark developer to help manage and process big data sets on AWS. The successful candidate will have a strong knowledge of key AWS se...
Read moreComprehensive GCP Data Lakehouse App Build
I'm in need of proficient developers to build a large project encompassing various technologies. The primary duties will involve: - Constructing a GCP data lake...
Read morePython Specialist for Diverse Applications
I am looking for a Python developer for job support. Who has good experience in Python, pyspark, and Shell Scripting. Minimum 5 years of experience. Must have e...
Read moreLong-Term Remote Data Engineer Opportunity in India
We are on the lookout for a seasoned Data Engineer to join our team in India for a period of 12 months. Languages: - SQL - Python - PySpark Cloud computing: - E...
Read moreExpert Spark on Kubernetes Support Needed - Job Support role
Requirements kubernetes ray spark docker hub Need to run spark on kubernetes and ray on kubernetes In office desktop every set up is done And then another one i...
Read moreComprehensive IT Training Video Creation
I am looking for a professional to design a series of training videos for beginners on Python, SQL, Pyspark, ADF, Azure Data Bricks, and Snowflake. The primary...
Read moreUrgent Big Data Engineer Needed
I'm looking for a skilled Big Data Engineer to assist with our group project. The project is due in 12 hours. Your main responsibilities will include: - Data Pr...
Read morePython Synapse Notebook to Databricks
I'm looking to migrate my existing 2 Synapse notebook, written in Python, to a Databricks notebook. The primary goal of this migration is to reduce costs. Key R...
Read moreConvert Code from Postgres SQL to PySpark SQL -- 3
I'm looking for someone with solid experience in Google Cloud Platform (GCP) and Databricks, specifically for data processing and analytics. Your primary respon...
Read moreConvert Code from Postgres SQL to PySpark SQL
I'm looking for someone with solid experience in Google Cloud Platform (GCP) and Databricks, specifically for data processing and analytics. Your primary respon...
Read moreConvert Code from Postgres SQL to PySpark SQL -- 2
I'm looking for someone with solid experience in Google Cloud Platform (GCP) and Databricks, specifically for data processing and analytics. Your primary respon...
Read moreDatabricks Data Engineer Needed
I'm looking for someone with solid experience in Google Cloud Platform (GCP) and Databricks, specifically for data processing and analytics. Your primary respon...
Read morePython, Spark ETL Developer
I am looking for a seasoned Python, Spark developer to assist with ETL processes who has worked on hash based algorithms to solve the given problem. Ideal Skill...
Read morePython Programming and Data Engineering Expert
I am in search of a seasoned professional who can provide valuable job support in two key areas: 1. Python programming: Mastery of Python is crucial for this pr...
Read moreUrgent Structured Data Engineer Needed
I am in need of a skilled Data Engineer with experience in processing Structured Data, particularly using Apache Spark. The project is time-sensitive and must b...
Read moreAdvanced T-SQL to PySpark Translation
I have a high-complexity T-SQL stored procedure used for data analysis that I need translated into PySpark code. The procedure involves advanced SQL operations,...
Read moreMarketing Data Analysis with Databricks
conversion modeling / predictive analytics. The whole department is transitioning to DataBricks. I need help with creating conversion models using pyspark. Comp...
Read moreDatabricks Data Engineer day to day usage Walkthrough
Day to day expert Walkthrough of Databricks usage tips and techniques
Read moreData Engineering Specialist Needed
I'm looking for a data engineer with solid Pyspark knowledge to assist in developing a robust data storage and retrieval system, primarily focusing on a Data Wa...
Read moreDatabricks Engineer for Delta Live Tables
I'm seeking a knowledgeable Databricks Data Engineer to expertly navigate Python and Pyspark programming languages for my project. Your primary task will be opt...
Read moreSpark Script for Hive to S3 Data Migration
Create a Spark script to transfer metastore data from Hive to S3 - Create a connection to Hive metastore - Fetch schema.table definition for the database - Crea...
Read moreAWS Architecture Design for Spark & Sagemaker
I'm looking for a skilled DevOps Engineer experienced in AWS to help design a robust architecture for my Spark and Sagemaker Machine Learning models. Key Requir...
Read morePredictive Modeling for Crop Optimization
I am working on a data science project that aims to develop a predictive model that will enhance agricultural production through crop yield predictions and dise...
Read moreData Processing with Python/PySpark
I'm in need of a proficient expert in Python or Pyspark programming to assist with a data processing project I'm currently working on, which requires handling f...
Read moreAzure Databricks Data Engineering Specialist
I am in need of an expert Databricks data engineer who is acquainted with DELTA LIVE TABLES. Get in touch if you can convert complex structures into useful busi...
Read moreAWS Sagemaker Migration for ML Notebooks
I'm in need of a Machine Learning Engineer who can migrate our existing notebooks from RStudio and PySpark to AWS Sagemaker. Your task will be to: - Understand...
Read moreData bricks Specialist Needed
I'm in need of a Databricks expert to help with a case study focused on building a solution architecture to serve the requirement as below. I need a document th...
Read morePySpark Debugging Specialist...
I am in need of a proficient PySpark coder to aid in debugging errors present within my current code. The main focus of this project is optimization and trouble...
Read morePySpark Debugging Specialist
I am in need of a proficient PySpark coder to aid in debugging errors present within my current code. The main focus of this project is optimization and trouble...
Read more