Azure Data Architect/ Engineer
The project requires building streaming data pipeline using Azure Event Hubs and Python/Data bricks for processing the data from ADLS or cloud storage. An exper...
Read more
ID / Date
Listing
Link
PySpark code
Some operations on pyspark.pandas dataframes.
Read moredata mapping(aws glue, pyspark, postgresql)
records needs to upgrade in the PostgreSQL table using glue job. need to write pyspark script that will upgrade the records in PostgreSQL table.
Read moreNeed help with PySpark and Databricks
I need a strong mentor and a support member for my latest PySpark & Databricks project. Requires PySpark coding and troubleshooting with Databricks. Looking for...
Read morespark sql scala notebook
spark sql scala notebook project contact for more details
Read morePySpark Hadoop AWS Expert
Hi Expert, I need a technically strong mentor for Hadoop PySpark to help me. Looking forward to collaborate for a long time.
Read moreAzure Databricks with SQL ,Python, Power BI
I am looking for a resource that can transform data and maintain data warehouse in Databricks using PySpark , Python and SQL. Integration with Power BI is requi...
Read moreHadoop PySpark Expert
Hi, I need a technically sound person on Hadoop PySpark for mentor sessions as part of learning.
Read moreaws data migrating(s3, aws glue and pyspark, PostgreSQL)
we need to migrate data from s3 to PostgreSQL using AWS glue job. we need to write simple pyspark script that will update the table records in Postgresql.
Read moreaws data migrating(s3, aws glue and pyspark)
the task is to create a simple pyspark script using glue job that will update the table records in the prosgresql
Read moreAws data migration(aws glue, s3, spark, Pyspark/python script)
My project is to create aws data pipe line using aws glue and python script. Our Source is s3 and target prosgresql. We need to write a spark script that will c...
Read morePySpark AWS Project
Hi Expert, I want a technically strong person on Bigdata with PySpark & AWS Cloud to help me in doing projects. I am planning to do few POC's on PySpark & AWS w...
Read moreAws data mapping(aws glue, s3, spark, Pyspark/python script)
My project is to create aws data pipe line using aws glue and python script. Our Source is s3 and target prosgresql. We need to write a spark script that will c...
Read moreSpark-Scala -- 2
Spark, Scala, Big Data, Hive, HDFS, Impala, Scheduling tool like Autosys, CA Automic, Control-M and shell-scripting
Read moreSpark-Scala
Spark, Scala, Big Data, Hive, HDFS, Impala, Scheduling tool like Autosys, CA Automic, Control-M and shell-scripting
Read morePandas DF Vs Pyspark DF
1. Read large input CSV file and convert into Pandas DF 2. Read same large CSV input file and convert into Spark DF Prove that Pandas DF missing data, but Spark...
Read morePySpark code issue
I have a project which involves connection from a up-steam systems to down stream sub-systems and we have to decommission some of the upsteam-systems and assign...
Read moreDjango + Spark
Make an integration of Spark in my Django project
Read morePyspark project
2 tasks 1. Analysis of temperature of cities using pyspark 2. ML algorithm implementation using pyspark
Read morePredictive Price modeling for AirBnb Listings
Prepare the data, including data cleaning, transformations, and aggregation. Store the data in an SQL database. Query the data to make initial discoveries: deve...
Read moreData Engineer
Need a strong Data Engineer with overall 6+ years of experience and 3+ years of Experience in Data Engineering in AWS/Azure cloud platforms. Should be very hand...
Read moreAzure data bricks plus pyspark
Looking for someone who can provide the support in these 2 technologies
Read moreMarket-basket analysis - Movie recomendation - Algorithm development + report
The task is to implement an algorithm finding frequent itemsets (aka market-basket analysis), analyzing IMDB datasets described below The IMDB dataset is publis...
Read moreDevops Engineer with Amazon AWS web Services Expert required
Candidate must be familiar with CI/CD pipeline, AWS web services such as S3, EMR and Athena. Knowledge of SQL, Gituhub, pyspark, JAMS and Airflow UI is a plus.
Read moreMIcrosoft Azure, Cosmos DB and Cassandra Database Expert Required
Looking for the Expert who is well knowledgable in Microsoft Azure Services, Cosomos DB, Cassandra, Python and Pyspark. If you have these skills. Feel free to p...
Read moreLooking to hire a Senior AWS Data Engineer or ETL Developer required for full-time position
Responsibilities: • Enhancements, new development, defect resolution and production support of Big data ETL development using AWS native services. • Create data...
Read morespark and pyspark
I need to install spark and pyspark to windows then run code
Read moreNeed Big Data Developer experienced with Real time and Batch processing with solid programming skills
I am looking for the freelancer to develop solution by analyzing live data generated from some applications. Developer should be very capable of coding in Big D...
Read moreAWS Glue ETL (Pyton, PySpark) with other Microservices S3, SNS, CloudWatch, Step Functions, Workflow, Lambda -- 2
AWS Glue ETL (Pyton, PySpark) with other Microservices S3, SNS, CloudWatch, Step Functions, Workflow, Lambda
Read moreAWS Glue ETL (Pyton, PySpark) with other Microservices S3, SNS, CloudWatch, Step Functions, Workflow, Lambda
looking for Help with AWS Glue ETL with other Microservices S3, SNS, CloudWatch, Step Functions, Workflow, Lambda
Read moreReal-time stream processing using Kafka and Spark
Hi all, I have a Real-time stream processing project using Kafka and Spark I need someone who is good in Python, PySpark, Kafka and Jupyter Notebook I have done...
Read moreMarket-basket analysis - Movie recomendation -- 2
The task is to implement an algorithm finding frequent itemsets (aka market-basket analysis), analyzing IMDB datasets described below The IMDB dataset is publis...
Read morei require a programmer
I require the solution for https://github.com/databricks-academy/developer-foundations-capstone
Read moreMarket-basket analysis - Movie recomendation
The task is to implement an algorithm finding frequent itemsets (aka market-basket analysis), analyzing IMDB datasets described below The IMDB dataset is publis...
Read moreSpark Structured Streamming
This project needs a spark structured streaming program which needs to be done in Pyspark. Need to stream the CSV files with Pyspark. The code should be able to...
Read morelooking for Vendors/resources Expert in Azure Data engineering with Data bricks dev exp
Hi everyone we are looking for Vendors/resources Expert in Azure Data engineering with Data bricks dev exp in the exp range of 3-10 years, resources should be b...
Read morelooking for Vendors/resources having Pre-onboarded Pyspark+Scala developers with good SQL development skills
Hi everyone we are looking for Vendors/resources having Pre-onboarded Pyspark+Scala developers with good SQL development skills in the exp range of 3-10 years,...
Read morePyspark and ML
I am looking for some who has a good knowledge of working with spark (python version) and Machine learning task
Read moreBig Data and Machine Learning Expert for full time for 6-12 months
In your Bid please mention the Monthly salary that you would like to get for full-time per month. We're seeking someone who: • Has minimum 5 years of experience...
Read moreSpark performance optimizations help needed ASAP
Need male help on code spark - pyspark on optimization and functional code, NEED ASAP, pseudo code is already written to handle read 1.4 TB of dataset and joins...
Read more