simple rest api and spark with python fastapi+spark -- 2
a simple task of rest api system design and spark with kafka
Read more
ID / Date
Listing
Link
Exp. Developer with Skills of Java Spring Boot & Python PySpark
We are seeking a skilled developer with expertise in Java Spring Boot and Python (specifically PySpark) to join our team. In this role, you will be responsible...
Read moreDevOPS Engineers - AWS & PySpark
We are hiring a DevOps Engineer with expertise in AWS, PySpark, and Python. Your main responsibilities will include designing, implementing, and maintaining sca...
Read morePyspark & AWS Python Code Configuration
Hello , We have a PySpark Code that need to deployed and reconfigure in AWS EC2 Server and make it up and running the code Only if you have exp. in PySpark and...
Read moreGenerate counterfactual images using Generative Adversarial Networks and Diffusion models
Objective: 1. Generated counterfactual images 2. Generate text to images
Read moreConvert CSV File into JSON
I am looking for a freelancer who can convert my entire CSV file into JSON format using Python. The JSON output needs to be formatted in a specific way, as I ha...
Read moreTeach data engineering
I am looking for a data engineering expert to teach me, a beginner student, through live online sessions. The ideal candidate should have experience teaching an...
Read moreConvert PySpark to SQL
I am looking for a developer to help me convert my PySpark codebase, which is currently small (less than 400 lines), to SQL. The ideal candidate should have exp...
Read moreSpark Structured Streaming (SSS) Project -- 2
Use SSS to solve this project. The requirements are as follows: a. Input source: Fafka or any other related software b. Operations: i. Aggregation with grouping...
Read morePyspark Machine Learning small task for tonight
We are looking for a skilled PySpark developer with experience in Machine Learning to help us with a small task that needs to be completed tonight. The task inv...
Read moreSpark task optimization
I am looking for someone who can optimize the memory usage in my Spark tasks. Currently, I am experiencing general slow performance and I believe this is due to...
Read moreSpark Structured Streaming (SSS) Project
Use SSS to solve this project. The requirements are as follows: a. Input source: Fafka or any other related software b. Operations: i. Aggregation with grouping...
Read moreI need coder
Hi , I have scenario. I want write a FTP program. In that one of the json file contains 10 userid and passwords are avalibile. While running on program it has t...
Read moreSpark SQL structed streaming question
I am looking for a Freelancer who can help me form an answer to a complex structed streaming question in Spark SQL. Specifically, I need help with a data source...
Read moreSmall Project - Integrade Deequ With Glue
I need a person who is professional at writing deequ
Read moreBulk ingestion into janusgraph using pyspark
There is a requirement to bulk ingest data into Cassandra db through Janusgraph using pyspark. There is a Java application which ingest data into gcp instance J...
Read moreNeed Azure Data Engineer Datafactory, SSIS, Python and Pyspark
Need Azure Data Engineer Datafactory, SSIS, Python and Pyspark Mon-Fri 2 hrs connect Monthly payment: 8k
Read morePython - Transcribir script a librería Pandas
Poseo un script en funcionamiento y solo necesito pasarlo a python con libreria pandas. El mismo ejecuta una serie de SQLs ya armados (1 drop, 1 create, 2 inser...
Read moreaws glue pyspark project
Need someone who has good experience in spark,redshift,s3 and aws glue
Read moreBuild job on aws glue
Read data from sql server and write to redshift
Read moreAWS Data Engineer
Data Migration from RDBMS to AWS S3 and Redshift 1. Creating a framework that converts scripting languages like PLSQL, BTEQ etc to Python and PySpark to use Dat...
Read moreData Engineer: Python+Pyspark - Fulltime Contract base IST Time
Need Data Enginner for fulltime contract basis remote work 8 hours per day .Mon To Fri 10am to 7pm IST Skill : Python+Pyspark Exp : 3 to 5 years Bid with your m...
Read moreNeed help on Data Mining task with PySpark
Two python scripts, task1.py and task2.py, that adhere and successfully execute the requirements. The task is implementing the SON algorithm for finding frequen...
Read moreHadoop Big Data engineer required for Job Support
Position: Hadoop Big Data Developer Type: Remote Screen Sharing Duration: Part-Time Monday to Friday 4 hours a day Salary: $700 Per Month (57,000 INR per month)...
Read morePost List as Json to REST API using Pyspark in AWS Glue
Please help in posting a list (list have query as string) as JSON to REST API using pyspark in AWS Glue
Read morePyspark jobs
SQL to Pyspark scripting for project requirements
Read moreSAS to Pyspark conversion
Have to convert the SAS code to Pyspark in azure
Read moreData Engineer
Data Engineer work related to Azure Data factory and Databricks using python and SQL
Read moreQuery to be build in pyspark
Please build a query in pyspark to create as shown in excel output
Read moreSpark , Mllib and Python developer
Need anyone who has hands-on Experience in spark and python. Minimum of 2 years experience. Should be able to code in pyspark.
Read morebuiild a user suggetion and predictive model for my exam app
buiild a user suggetion and predictive model for my exam app
Read moreBig data Analytics with MLlib and pyspark with Nlp expertise
There are 4 deliverables. And here is how I had drafted a possible way to address them. 1: Identifying a multinational company of choice. - my suggestion: Let u...
Read moreProcessing 15 GB text file using GCP Dataproc with Spark (fixed width files)
I have a pyspark code which is working for small files to process fixed width files on GCP dataproc cluster, but when I'm reading 15GB of compressed gzip text f...
Read moreBuild a algorithm using Databricks Azure with spark, pyhton and sql
Save data generated in a table Setting a job in databricks to save dayli info Improve the speed of calculations
Read moreAmazon Sagemaker expert with familiarity with EMR
Need to create a notebook to process data using EME, train a ML model using sagemaker training and orchestrate using sagemaker pipeline. All in notebook. Sample...
Read morepyspark developer
Hello, I want to train a ML model in pyspark with very easy concept
Read moreConvert python data processing and ML steps in Pyspark
I have few notebooks described for each steps. I need them converted to pyspark and spark modularised code. Need someone with experience in spark and python. Ma...
Read moreRegression and Classification in Pyspark
Hello there, I need someone to complete some PySpark tasks here very quickly.
Read moreParse a JSON String column using pyspark
Parse a column of JSON string in Pyspark
Read morePyspark/sql Mini Project
I will provide you with only one pyspark/spark question
Read more