DB and DW setup in AWS via IaaS script (Terraform or other)
Budget: $250 – $750 NZD
We have a project data modelling cross platform application that we are in the early stages of building. The application will be storing data in both transactional databases and in a data warehouse where we will be looking to build various Power BI dashboards and reports from.
Presently we have a blank AWS free tier account and some simple table data in Excel / Access, and need to move this into a database, then from that database via some simple ETL's we want to get the data into a data warehouse environment, so we can begin to build the Power BI Dashboards and reports that our cross platform (web and mobile apps) will consume.
We are open to what database we should install, be it Maria DB, My SQL, Postgres, SQL Server or other.
What we seek from this assignment is to find someone experienced in creating IaaS scripts (terraform or other) to setup two environments (Dev and Production) with the agreed database and Data Warehouse servers in place and ready to receive data.
We will load our excel / access data to the database, but would need help with setting up the Data Warehouse (fact & dimension tables plus ETL) for one of the tables to prove operational working of the DB and DW.
Deliverables:
-------------------
1) Database and Data Warehose technologies recommended and selected (agreed)
2) Minimal Costs of operation but expandable to suit future demand
3) Terraform or other IaaS Code scripts to create Dev & Prod Environments with operational DB and DW in line with CI/CD and DevOps practices
4) Costs of operation easily manageable - knowledge transfer about how to manage our AWS costs etc.
5) Willingness to partner with us on future assignments (such as management of the AWS environment and/or other ETL's and DW data models)
Assignment Notes:
------------------------------
1) While we are in development mode we are looking to save costs, as such we have an AWS free tier account. Having said that if we need to purchase tools and or services to get the beset development environment we are willing to appraise the merits of purchasing additional pay for services.
2) Whilst we are looking for someone experienced in setting up AWS DB and DW services (as well as designing DW fact/dimensions and ETL's) we are happy if the assignment winner utilises exisitng code scripts such as those that can be found on library sites such as https://www.gruntwork.io/infrastructure-as-code-library/
Successful Candidate attributes:
---------------------------------------------------
* Experienced with AWS platform and environement configuration
* Experienced with Terraform or other appropriate IaaS scripting
* Experienced with Database and Datawarehouse setup
* Experienced with Datawarehouse Fact / Dimension table modellng and setup
* Experienced with building / coding the ETL's between the selected database and datawarehouse
Presently we have a blank AWS free tier account and some simple table data in Excel / Access, and need to move this into a database, then from that database via some simple ETL's we want to get the data into a data warehouse environment, so we can begin to build the Power BI Dashboards and reports that our cross platform (web and mobile apps) will consume.
We are open to what database we should install, be it Maria DB, My SQL, Postgres, SQL Server or other.
What we seek from this assignment is to find someone experienced in creating IaaS scripts (terraform or other) to setup two environments (Dev and Production) with the agreed database and Data Warehouse servers in place and ready to receive data.
We will load our excel / access data to the database, but would need help with setting up the Data Warehouse (fact & dimension tables plus ETL) for one of the tables to prove operational working of the DB and DW.
Deliverables:
-------------------
1) Database and Data Warehose technologies recommended and selected (agreed)
2) Minimal Costs of operation but expandable to suit future demand
3) Terraform or other IaaS Code scripts to create Dev & Prod Environments with operational DB and DW in line with CI/CD and DevOps practices
4) Costs of operation easily manageable - knowledge transfer about how to manage our AWS costs etc.
5) Willingness to partner with us on future assignments (such as management of the AWS environment and/or other ETL's and DW data models)
Assignment Notes:
------------------------------
1) While we are in development mode we are looking to save costs, as such we have an AWS free tier account. Having said that if we need to purchase tools and or services to get the beset development environment we are willing to appraise the merits of purchasing additional pay for services.
2) Whilst we are looking for someone experienced in setting up AWS DB and DW services (as well as designing DW fact/dimensions and ETL's) we are happy if the assignment winner utilises exisitng code scripts such as those that can be found on library sites such as https://www.gruntwork.io/infrastructure-as-code-library/
Successful Candidate attributes:
---------------------------------------------------
* Experienced with AWS platform and environement configuration
* Experienced with Terraform or other appropriate IaaS scripting
* Experienced with Database and Datawarehouse setup
* Experienced with Datawarehouse Fact / Dimension table modellng and setup
* Experienced with building / coding the ETL's between the selected database and datawarehouse
Related categories:
Amazon Web Services
Database Administration
Database Development
Data Warehousing
Aws Lambda