Big Data Engineer
Budget: $15 – $25 USD
In our international team we want to see a cool and professional Big Data Engineer, who will be the backbone of the data team and will be responsible for developing and monitoring the data collection pipeline.
Tasks:
• Creating or updating data pipeline features using GCP components such as data flow, bigquery, bigtable;
• Development of new services, dashboard for real time data quality and development of monitoring process;
• Participate in the design and implementation phases of new microservices and machine learning functions connected to the pipeline;
• Explore and implement new data sources;
• Pipeline monitoring
Requirements:
• Strong knowledge of one of the following technologies: apache beam ou spark, et hadoop;
• Strong knowledge of Java, Python and/or Golang;
• At least 2 years of experience as a data processing engineer;
• Knowledge of Clickhouse;
• A good level of English (written and spoken);
• Experience of working with a cloud platform
Nice to have:
• An understanding of cro and/or web analytics;
• You know what it means to work in a team and work with other teams;
• You can put yourself in the customer's shoes to analyse their actual needs
If you are interested in the project, please tell us in an email about your previous experience.
Tasks:
• Creating or updating data pipeline features using GCP components such as data flow, bigquery, bigtable;
• Development of new services, dashboard for real time data quality and development of monitoring process;
• Participate in the design and implementation phases of new microservices and machine learning functions connected to the pipeline;
• Explore and implement new data sources;
• Pipeline monitoring
Requirements:
• Strong knowledge of one of the following technologies: apache beam ou spark, et hadoop;
• Strong knowledge of Java, Python and/or Golang;
• At least 2 years of experience as a data processing engineer;
• Knowledge of Clickhouse;
• A good level of English (written and spoken);
• Experience of working with a cloud platform
Nice to have:
• An understanding of cro and/or web analytics;
• You know what it means to work in a team and work with other teams;
• You can put yourself in the customer's shoes to analyse their actual needs
If you are interested in the project, please tell us in an email about your previous experience.