ETL process from data base to EDW
Budget: $30 – $250 USD
Scenario: Data Ingestion
A request was sent in to Data Engineering to ingest two new tables from Epic. Epic is the Electronic Medical Records system used at MUSC. These tables will need to be loaded from the Epic server: VS-CLARITY on the database: Clarity into the Data Warehouse server: EDW on the database: EDWTest. The two tables are LOCATION and PROVIDER. The end goal is to use specific attributes from the tables and model them into new dimension tables. Note: Both VS-CLARITY and EDW are Microsoft SQL Servers.
Attributes from the source tables include:
dbo.PROVIDER
PROVIDER_ID, PROVIDER_NAME, PROVIDER_ADDRESS, PROVIDER_ACTIVE
dbo.LOCATION
LOCATION_ID, LOCATION_NAME, LOCATION_ACTIVE
What Microsoft tools would be best to ingest the two new tables into the Data Warehouse?
What steps could be used to check and make sure the data from the Clarity database matches the data within the EDWTest database?
A request was sent in to Data Engineering to ingest two new tables from Epic. Epic is the Electronic Medical Records system used at MUSC. These tables will need to be loaded from the Epic server: VS-CLARITY on the database: Clarity into the Data Warehouse server: EDW on the database: EDWTest. The two tables are LOCATION and PROVIDER. The end goal is to use specific attributes from the tables and model them into new dimension tables. Note: Both VS-CLARITY and EDW are Microsoft SQL Servers.
Attributes from the source tables include:
dbo.PROVIDER
PROVIDER_ID, PROVIDER_NAME, PROVIDER_ADDRESS, PROVIDER_ACTIVE
dbo.LOCATION
LOCATION_ID, LOCATION_NAME, LOCATION_ACTIVE
What Microsoft tools would be best to ingest the two new tables into the Data Warehouse?
What steps could be used to check and make sure the data from the Clarity database matches the data within the EDWTest database?
Related categories:
SQL
Database Administration
Database Programming
Microsoft SQL Server
Database Development