Sr. Data Engineer

$ 250.00 — 750.00 USD
Data Engineer Job Responsibilities:

Develops and maintains scalable data pipelines and overall data platform architecture
Identifying and re-designing data infrastructure for greater scalability, optimizing data delivery, and automating manual processes
Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision-making
Designs multiple data integrations from multiple sources and different input formats
Implements processes and systems to monitor data quality, ensuring production data accuracy and availability
Performs data analysis required to troubleshoot data-related issues and assist in the resolution of data issues.

Works closely with a team of frontend and backend engineers, product managers, and analysts.

Works closely with all business units and engineering teams to develop a strategy for long-term data platform architecture.

looking for a candidate with 5+ years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field.
They should also have experience using the following software/tools:

Experience with big data tools: Hadoop, Spark, Kafka, Flink, Storm, etc
Experience with AWS cloud services: EMR, RDS, Redshift, Kinesis, Athena, etc
Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.

Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.

Experience with stream-processing systems: Storm, Spark-Streaming, etc.

Experience with object-oriented/object function scripting languages: Python, Scala, Java, C++, or similar
Certified Data Analytics – Specialty or similar Data Engineer certification is a plus

- Data Engineering Tools
Apache Kafka, Apache Hadoop, Apache Cassandra, Apache Airflow

Similar Freelance jobs:

Mobile App Developer - Android / Ios
Role / requirements:\r\nMobile application developer wanted urgently for a simple mobile app project.\r\nLooking for freelance / contract arrangement at the moment with possibility of a full time role later.\r\nMust be familiar with Titanium and Phonegap\r\nMust be familiar with web application architectures (client - server setup)\r\nAble to develop and program independently based on technical user requirements provided.\r\nMulti platform dev experience would be very useful - I.e. trigger, phonegap, appcelerator.\r\nUI design experience is a plus.\r\nNo educational requirements needed as long as you…
Full Description of Mobile app developer - Android / iOS
Write Some Software
* Create Master Port Module at Ship Management by Struts 1 framework on Java * Create journal entry for module PO and Invoice by Struts 2 framework on java
Full Description of Write some Software
Implantação Do Gateway De Pagamentos Getnet
Temos plataforma de e-commerce própria e gostaria de integrar o gateway de pagamentos da GetNet. Para integração da nossa API, 0 desenvolvedor terá que se basear na nossa documentação: https://protect2.fireeye.com/v1/url?k=698967fd-36125a5b-698baa44-ac1f6b1e02f6-a37a19790941a8d5&q=1&e=89f19824-e52a-467f-9fd6-728ca3b62687&u=https%3A%2F%2Fdevelopers.getnet.com.br%2Fapi Obs: Banco de Dados MySQL e código fonte desenvolvido utilizando Visual Studio 2013
Full Description of Implantação do gateway de pagamentos GetNet
Zamaso Inc
I need scripts from textnow or any wesbsite of sending free sms With this script i need to send bulk sms
Full Description of Zamaso inc
Crear Un Software
Software de ingeniería aplicada a la geología para ingreso de datos, generación de gráficos y entorno de consultas. Sistema operativo Windows, posteriormente a iOS y Android.
Full Description of Crear un software
I Want To Build A Tool Using Hap.py Benchmarking (nist) To Validate Any Vcf File By Running The File
The inputs to hap.py are two VCF files (a "truth" and a "query" file), the truth file is found here https://www.nature.com/articles/sdata201625/tables/3 which includes extensive genome sequencing for 1 person. So we can validate any VCF file by comparing our VCF with the truth VCF and the outcome will include a table with TP FP TN FN and precision with the sensitivity you can read more about it on this page: https://github.com/RealTimeGenomics/rtg-tools https://github.com/Illumina/hap.py/blob/master/doc/happy.md#working-with-genome-vcfs
Full Description of I want to build a tool using Hap.py…
Api & Web App For Interactive Brokers
I need an API & web app for Interactive brokers that will buy and sale stocks based on settable criteria in the API. The trades will be based on stock information received from a 3rd party data scraping service. The API must be able to trade three separate types of signals. See attached notes and UI layout for details of the project.
Full Description of API & Web App for Interactive Brokers
Secure Link Topology Architecture For Software Defined Networking (sdn)
I'm a researcher in Computer Networks, whose areas of interest in Software Defined Networks. 1.The project is to re-implement the attached file on SLDP: A secure and lightweight link discovery protocol in software defined networking and get the actual results with the use of Mininet emulator and Ryu controller. Also identify the weaknesses of the work 2. After the re-implementation, the weaknesses are to be strengthen 3. propose a secure and distributed link discovery protocol for software defined networking 4.…
Full Description of Secure Link Topology Architecture for Software Defined Networking…
Build An Sram Memory Compiler Based On "openram" Project.
A configurable SRAM compiler written in Python to tile the bit cells and address decoder blocks, extract the Verilog and parasitic RC models, and generate the GDS2 block database. The project should leverage the "openRAM" open source code as much as possible to achieve the above objectives.
Full Description of Build an SRAM memory compiler based on "openRAM"…
Create A Script To Collect Information -- 2
I would like to create a script to automate some repettive task on Excel and to collect some info on Google and a Website
Full Description of Create a script to collect information -- 2
Pms Hotel System
Hello look forwared property management system, system have to including front desk, back desk, accounting, room servicess and reports ..etc. web site and mobile application system have to work online from any where as per authruty for each stockholders hope to done it with creative team that have experiance with similar job
Full Description of PMS hotel system
Linux Distro
Hi everyone! I'm looking for a embedded systems engineer someone with vast knowledge on C++, QT, Kirigami UI Framework, Maui Project Framework these frameworks and knowledge in this language would be of great help in my creation a device I'm engineering. Other important areas of expertise: KDE Plasma, Calamares Installer, Kubuntu Invite will need to sign NDA. Thank you!
Full Description of Linux Distro
© 2006 — 2026 hirelancer.com is an affiliate website, listing the freelance projects. We are collaborating with other sites like getFreelancer.com. Feel free to bid on any project and good luck! You will need register first, before bidding or posting projects. Basic memberhsip is always free. We might earn commissions from referring you. You will never ever pay additional fees for we referred you.