GCP DATA WAREHOUSE
Budget: $30 – $250 USD
I am looking for a freelancer to help me set up a complete data pipeline and data mode using GCP data warehouse. The primary purpose of the data warehouse is to get all timedoctor api time use data for a month for all available users and store it in a data warehouse. (Only 1 API call per second).
The API calls should handle failures gracefully and retry appropriately, Just handle a couple of status codes - 404, 403.
Ideal Skills/Experience Required:
Hands-on data ingestion using ratelimit and throttling pattern.
Experience with Initial ingestion pattern and Scheduled incremental ingestion pattern.
Data Pipeline Documentation (Diagram or written).
Expertise with DBT to build a data model of Clean and no duplicate data.
The API calls should handle failures gracefully and retry appropriately, Just handle a couple of status codes - 404, 403.
Ideal Skills/Experience Required:
Hands-on data ingestion using ratelimit and throttling pattern.
Experience with Initial ingestion pattern and Scheduled incremental ingestion pattern.
Data Pipeline Documentation (Diagram or written).
Expertise with DBT to build a data model of Clean and no duplicate data.