Creating new Data Process in Azure
Budget: £36 – £0 GBP
We are currently looking to create a process in Azure within our business.
The process in question will feed data into a storage account from either a locally mapped drive or Sharepoint and then utilise Data Factory to pass the data into an online SQL instance where we will be running some stored procedures to cleanse / get it reporting ready.
The whole process is fairly straightforward in terms of what we are looking to achieve, but we lack the Azure experience (we are a team of SQL developers). We do already have an Azure environment in place but are not utilising it to its full potential.
In Full
- Create a data transfer process between our local computers / SharePoint and Azure
- Create data pipelines in Azure Data Factory to transfer the data to an Azure SQL instance
- Create error handling and mitigation for the process
- Document end to end process
- Train internal users on the build and documentation
The process in question will feed data into a storage account from either a locally mapped drive or Sharepoint and then utilise Data Factory to pass the data into an online SQL instance where we will be running some stored procedures to cleanse / get it reporting ready.
The whole process is fairly straightforward in terms of what we are looking to achieve, but we lack the Azure experience (we are a team of SQL developers). We do already have an Azure environment in place but are not utilising it to its full potential.
In Full
- Create a data transfer process between our local computers / SharePoint and Azure
- Create data pipelines in Azure Data Factory to transfer the data to an Azure SQL instance
- Create error handling and mitigation for the process
- Document end to end process
- Train internal users on the build and documentation