There are different csv file that should be stored in data lake. I'm looking for a solution to whenever we added a csv file to the sharepoint folder, based on this solution is stored in data lake.
One of the solution is using Power app to save the csv file into the dataverse via Power Automate and then connect dataverse to the data lake.
This solution should be considered for any new csv file that will be add to the folder.
When a csv fill is added
[login to view URL] file already has a related table in dataverse?
[login to view URL] yes, should data be updated or inserted?
[login to view URL] update, so is updated otherwise inserted.
[login to view URL] no, creat a new table in dataverse and inserted to the table.
5. When dataverse is updated data lake will be updated.
I need a low level architecture diagram, as well.
If you have any other ideas, more than welcome!