Rapid Integration Data Pipeline Construction
Budget: $8 – $15 USD
Need assistance with the development of a well-structured, efficient data pipeline. This system is expected to integrate a range of data sources, including APIs, DB views and SFTP, and prepare them for backend ingestion in CSV format.
Key Responsibilities:
- Source data from APIs, DB views, and SFTP
- Transform ingested data into CSV format
Ideal Skills and Experience:
- Expertise in creating and managing data pipelines
- Proficiency in various data integration methods, specifically APIs, DB views, and SFTP
- Excellent knowledge of data transformation and loading processes
Please note: While optional transformations like data filtering, aggregation, and mapping are not explicitly required, the ideal candidate should be able to provide guidance and recommendations on these aspects if necessary.
This project is of high urgency and I'm looking for someone who can start immediately.
Key Responsibilities:
- Source data from APIs, DB views, and SFTP
- Transform ingested data into CSV format
Ideal Skills and Experience:
- Expertise in creating and managing data pipelines
- Proficiency in various data integration methods, specifically APIs, DB views, and SFTP
- Excellent knowledge of data transformation and loading processes
Please note: While optional transformations like data filtering, aggregation, and mapping are not explicitly required, the ideal candidate should be able to provide guidance and recommendations on these aspects if necessary.
This project is of high urgency and I'm looking for someone who can start immediately.