Importing CSV files from Sharepoint to data lake.
Budget: $30 – $250 AUD
There are different csv file that should be stored in data lake. I'm looking for a solution to whenever we added a csv file to the sharepoint folder, based on this solution is stored in data lake.
One of the solution is using Power app to save the csv file into the dataverse via Power Automate and then connect dataverse to the data lake.
This solution should be considered for any new csv file that will be add to the folder.
When a csv fill is added
1.The file already has a related table in dataverse?
2.If yes, should data be updated or inserted?
3.If update, so is updated otherwise inserted.
4.If no, creat a new table in dataverse and inserted to the table.
5. When dataverse is updated data lake will be updated.
I need a low level architecture diagram, as well.
If you have any other ideas, more than welcome!
Cheers,
One of the solution is using Power app to save the csv file into the dataverse via Power Automate and then connect dataverse to the data lake.
This solution should be considered for any new csv file that will be add to the folder.
When a csv fill is added
1.The file already has a related table in dataverse?
2.If yes, should data be updated or inserted?
3.If update, so is updated otherwise inserted.
4.If no, creat a new table in dataverse and inserted to the table.
5. When dataverse is updated data lake will be updated.
I need a low level architecture diagram, as well.
If you have any other ideas, more than welcome!
Cheers,