Big Data Engineer Required With Scala, Spark, SparkQL, Oozie, Hive, ETL, CI/CD Pipeline Skills, Impala

$ 250.00 — 750.00 CAD
Develop end-to-end big data production pipelines using scala.
Need to be good with Scala, Spark, Hive, Impala, ETL, CI/CD pipeline skills, deployment process .
Good Knowledge of Workflow engine Oozie.
Expertise knowledge on Spark Dataframe.
Good knowledge of Shell script

We're looking for someone to assist us for 2/3 days.

Similar Freelance jobs:

Build Me Customer Portal And Admin Portal
My business needs to be able to create two portals for our customers. they are business that need to manage wireless services among different phone carriers. the carriers have provided their api to integrate with their systems the portals that I need created will look like the pictures, the issue is that I need a developer that can connect those actions under "tools" from our website to the carrier's portals. The carrier's AT&T, T-Mobile, Veirzon and Claro have all provided…
Full Description of Build me customer portal and admin portal
Problem With Spark Ar Filter
Need filter for instagram to be fixed. The image should be inside but instead it is cut off as seen in the image
Full Description of problem with Spark AR filter
Looking For Devops Job Support
• Extensive experience in the design and implementation of fully automated Continuous Integration, Continuous Delivery, Continuous Deployment pipelines and Devops processes for Agile projects across the Financial, Broadcast and Media Sectors • Deploying, configuring, managing, chef server and nodes machines using chef and Ansible automation. • Configuring and maintaining chef and Ansible servers, creating modules and pushing them to chef and Ansible clients. • Used Ansible Playbooks to setup Continuous Delivery Pipeline. Deployed micro services, including provisioning AWS environments using…
Full Description of looking for devops job support
Django E-commerce
I am building E-commerce using Django. front end is React and almost done. I am finding Django expert. Regards
Full Description of Django e-commerce
Spark Scla
Expertise in designing and deployment of Hadoop Cluster and different analytical tools including Pig, Hive, HBase, Sqoop, Kafka Spark with Cloudera distribution. Working on a live 20 nodes Hadoop cluster running on CDH4.4. Working with highly unstructured and semi structured data of 40 TB in size (120 TB with replication factor of 3) Managing external tables in Hive for optimized performance. Very good understanding of Partitions and Bucketing in Hive Developed Spark scripts using Scala as per the requirement using…
Full Description of Spark Scla
Creating Repo In Bitbucket Server
Hello, I want to create a repo in BitBucket server using power shell scripts using BitBucket server api’s
Full Description of Creating repo in BitBucket server
Scala Developer Required With Big Table
Hi All, I am looking for scala developer with below knowledge; SCALA, BIGTABLE BIGQUERY Regards Pavan
Full Description of Scala developer required with big table
Looking For Github Action Expert
I am looking for someone to auto deploy me site on aws or digitalOcean or anywhere. the site is dockerized. Can anyone setup github action?
Full Description of Looking for github action expert
Programador Web Front End
Busco trabajo o participiar en algun proyecto, tengo conocieminetos en html5, css3, javascript, bootstrap, git, webpack, react, consumo de api rest
Full Description of Programador Web Front End
App - Form In Rails To Use With
Using a defined A4 template, I have to insert in 21off locations the following : 1) 4 STRINGS, to be inputed 2) Datamatrix code, generated from point 1 3) a layout image, selectable Please quote for an application in rails containing the form.
Full Description of APP - Form in Rails to use with
Simple Assignment Using Hive And Pig
All details are mentioned in the attached doc. Please check before bidding. It will take you 4 to 5 hour to complete it
Full Description of Simple assignment using hive and pig
Fullstack Ruby On Rails Developer To Fix A Deployment Bug
I have an app hosted in Heroku, and I'm having a deployment issue. The app works great in development, but fails to compile when pushed to Heroku. Stack used: ruby 2.6.6 rails 6 webpacker tailwindcss v2 postcss-loader This is a partial of the errors I get: ERROR in ./app/javascript/stylesheets/custom.scss Module build failed (from ./node_modules/mini-css-extract-plugin/dist/loader.js): ModuleBuildError: Module build failed (from ./node_modules/postcss-loader/src/index.js): Error: PostCSS plugin postcss-purgecss requires PostCSS 8. Migration guide for end-users: https://github.com/postcss/postcss/wiki/PostCSS-8-for-end-users at Processor.normalize (/Users/path/node_modules/postcss/lib/processor.js:167:15) at new Processor (/Users/path/node_modules/postcss/lib/processor.js:56:25) at…
Full Description of Fullstack Ruby on Rails Developer to fix a…
Deployment Of A Django Website On Hostinger Vps
Website design using HTML, CSS, Javascript Proefficient with Hostinger VPS service Understanding on how to use a database like Postgres (prefered choice), SQLite, MongoDB, MySQL Object Relational Mapping (ORM) like Django's ORM or SQLAlchemey templating engine like Django template engine, Jinja2 production Web servers like Apache & Nginx Consumption of API like Sendgrid, Twilio, Stripe, Okata or find it in API marketplace like RapidAPI Selecting & using a WSGI server like Gunicorn, Mob_WSGI or uWSGI testing framework like Pytest &…
Full Description of Deployment of a Django website on Hostinger VPS
© 2006 — 2026 hirelancer.com is an affiliate website, listing the freelance projects. We are collaborating with other sites like getFreelancer.com. Feel free to bid on any project and good luck! You will need register first, before bidding or posting projects. Basic memberhsip is always free. We might earn commissions from referring you. You will never ever pay additional fees for we referred you.