Create a template document to extract all pipelines and all activities in each pipeline in azure data factory.
Budget: $30 – $250 USD
The document must state step-by-step how this would be done in a real-world with picture
I have about 120 pipelines in my azure data factory and I have managed to get all the pipeline runs information stored in our ADSL gen 2 as parquet format, however, I need to get the activities in each of these pipelines stored in another parquet file so we could access the information using PBI. Each pipeline has about 5 activities each in it and I would like to capture these activities.
Mind you I am not using any database but ADLS2. I need all the activities run each pipeline stored in a folder in ADLS in Parque format
I have about 120 pipelines in my azure data factory and I have managed to get all the pipeline runs information stored in our ADSL gen 2 as parquet format, however, I need to get the activities in each of these pipelines stored in another parquet file so we could access the information using PBI. Each pipeline has about 5 activities each in it and I would like to capture these activities.
Mind you I am not using any database but ADLS2. I need all the activities run each pipeline stored in a folder in ADLS in Parque format