Spark , Mllib and Python developer
Need anyone who has hands-on Experience in spark and python. Minimum of 2 years experience. Should be able to code in pyspark.
Read more
ID / Date
Listing
Link
Kafka and Spark Sql
Need to collect streaming data from S3 using Kafka and do some analytics using Spark sql and dump into a database
Read moreWe need Data Engineer with Azure cloud experience to work for 2 hrs a day remotely. We will give 25 to 30k inr per month
We need Data Engineer with Azure cloud experience to work for 2 hrs a day remotely. We will give 25 to 30k per month. Should work on all these technologies with...
Read moreSpecialised Service for the provision of Administration and Operation of the Red Hat OpenStack-based platform
diseño y creación de una infraestructura OpenStack para implementar una plataforma Big Data basa en hadoop/Spark. así como la implementación de la misma. Dentro...
Read moreBuild a algorithm using Databricks Azure with spark, pyhton and sql
Save data generated in a table Setting a job in databricks to save dayli info Improve the speed of calculations
Read moreSenior Azure Data Engineer (Europeans only)
As a Data Engineer you are responsible for the data pipelines, all imaging data, metadata, and tools for interacting with such data and have experience in proce...
Read moreFiltro de Instagram
Quisiera hacer 2 filtros de Instagram: 1) El primero quiero que sea con filtro vintage y sencillo. 2) El segundo quiero que sea un juego en donde diga, con que...
Read moreNeed a Data Architech
Need Data Architect with following skill set on Monthly Contracts o Mandate – Strong in Spark & ETL Anyone & More – AWS / Azure / Bigdata ( Cloudera – CDH )...
Read moreHDFS monitoring via spark streaming
hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh
Read morePyspark/sql Mini Project
I will provide you with only one pyspark/spark question
Read moreHDFS monitoring via spark streaming
Develop a spark streaming program with Scala to monitor a folder on HDFS in real-time such that any new file in the folder will be processed.
Read moreintegrate laravel breeze with laravel spark
I’m working on NextJS, Laravel app. Need to integrate laravel breeze(nextjs) with Laravel spark ( spark has all billing api ready )
Read moreNeed an Instagram filer which is pick an random image SparkAR
Need an Instagram filer which is pick an random image. I will provide you the details and need source code if I need changes in future.
Read moreData engineer -- 2
I need a Data Engineer having knowledge in Spark Scala Azure
Read moreData Engineer
Good knowledge on Azure. We have a Requirement in spark scala azure.
Read moreData Engineer
Strong Pyspark and coding skills Strong architecture level knowledge and has worked with Big Data Someone who has worked with AWS Glue, Terraform, AWS Step Func...
Read moreSimilarity Search using Big Data Management and Analytics
Please Go through the attachments you will have a clear idea of what is needed out of this project. Don't place a bid without going through the attachments plea...
Read moreI am looking for someone checking my code solution for a SparkSQL assignment
Hi, I am currently working on a SparkSQL project and would be needing someone who is very experienced in Data Science to look over my solution and comment if so...
Read moreHadoop Developer
You should be having experience working with java, flume, spark, hive Will share all details in further conversation
Read moreSpark program or HDFS monitoring
spark program to monitor folder on HDFS
Read moreNeed a data engineer with spark scala
Looking for someone who has good knowledge in spark scala
Read morePyspark & EMR developer needed
Total Experience : 4+ years to 7 years Designation : Sr. Data Engineer Mandatory skills : Pyspark & EMR Location : Pune /Remote Job Description - 1) Hands-on ex...
Read moreSome Spark and hive queries
Spark Use Case (Movie Review Analysis) IMBD is an online database of movie-related information. IMBD users rate the movies and provide reviews. They rate the mo...
Read morePass this notebook python script to Spark code
Hi there! I’m looking for a software engineer with python and spark proficiency. Specifically, we need that two functions of an ipython jupyter notebook file (....
Read moreConvert this notebook python script to Spark code
Hi there! I’m looking for a software engineer with python and spark proficiency. Specifically, we need that two functions of an ipython jupyter notebook file (....
Read moreBuild a SAAS Web App with Laravel and Spark
Hi there! I need a fullstack developer to create a SAAS web app with Laravel and Spark. Designs are complete in XD, and some portions of the frontend are comple...
Read moreLooking for Data Bricks Expert
Looking for Data Bricks Expert
Read moreParquet is more space efficient than JSON/CSV
It is generally said that the parquet format is better in terms of storage than JSON and CSV. The first link below says "Apache Parquet is a columnar file forma...
Read moreData engineer project
I am looking for an experienced data engineer who know how to create data pipelines, batch processing, scalability etc. Details about the project over chat.
Read moreData Engineer with Spark -- 2
Need someone who has epxerince in spark with python/Scala and any cloud experience will be good
Read moreMapReduce with Hadoop
The objective of this assignment is to learn how to design a distributed solution of a Big Data problem with help of MapReduce and Hadoop. In fact, MapReduce is...
Read moreData Engineering
I want a real time Industry data engineering project end to end with explanation and content.
Read mores3-to-opensearch
push data from s3 to opensearch with pyspark/spark,I want to connect a spark data frame to opensearch
Read moreOptimize Spark Job on VERY Large Datasets (Data Enrichment)
We have a Pipeline in which we are doing data enrichment. We aim to process a more than 30 TB data. Currently, we are only processing little less than 2percent...
Read moreStack : DATA ENG
Stack : DATA ENG 1. AWS 2. SPARK / HADOOP 3. PYTHON 4. Terraform
Read moreset up Kafka & Pyspark for structured streaming using python
Use the serverless Kafka and integrate it with Pyspark so the messages can be processed through Spark. You must be familiar with Kafka, Python, Spark and GitHub
Read morePySpark AWS help
After i run : print (get_id_to_topicd9("hadm_id", True, 50)) The result is: (PythonRDD[100] at RDD at PythonRDD.scala:53, []) I need to resolve this issue with...
Read moreExecuting Spark Jobs from External Python Script
Support Executing Spark Jobs from External Python Script Hi there! We are looking for a software engineer with python and spark proficiency. Specifically, we ne...
Read moreSpark with Cloud
Need someone who has experience in spark with scala/python and any cloud experience
Read moreNeed to tune ElasticSearch Cluster Performance.
ELASTIC SEARCH INTEGRATION IN SHORT We expanded our big data pipeline with a hot storage layer buillt in top of ElasticSearch. We aimed to query data and have f...
Read more