Need Data Engineer
Budget: $250 – $750 CAD
Desired development experience in building and maintaining data streaming jobs using Amazon Kinesis
Desired experience in working with database technologies and data development such as Python, PLSQL, etc.
Solid understanding of writing test cases to ensure data quality, reliability, and high level of confidence.
Track record of advancing new technologies to improve data quality and reliability.
Continuously improve quality, efficiency, and scalability of data pipelines
Knowledge of working with queries/applications, including performance tuning, utilizing indexes, and materialized views to improve query performance.
Identify necessary business rules for extracting data along with functional or technical risks related to data sources (e.g., data latency, frequency, etc.)
Develop initial queries for profiling data, validating analysis, testing assumptions, driving data quality assessment specifications, and define a path to deployment.
Familiar with best practices for data ingestion and data design.
Desired experience in working with database technologies and data development such as Python, PLSQL, etc.
Solid understanding of writing test cases to ensure data quality, reliability, and high level of confidence.
Track record of advancing new technologies to improve data quality and reliability.
Continuously improve quality, efficiency, and scalability of data pipelines
Knowledge of working with queries/applications, including performance tuning, utilizing indexes, and materialized views to improve query performance.
Identify necessary business rules for extracting data along with functional or technical risks related to data sources (e.g., data latency, frequency, etc.)
Develop initial queries for profiling data, validating analysis, testing assumptions, driving data quality assessment specifications, and define a path to deployment.
Familiar with best practices for data ingestion and data design.