Creation of Generic Data Set 💡

📍 Introduction:

In this post, we will see how to create a generic data set.

📺 Problem Statement:

Whenever a pipeline is made a new dataset needs to be created. So if we create a 100 pipeline 100 new data set needs to be created which is not a feasible solution. Hence we will create 1 generic dataset and use it across all the pipelines.

🔭 Steps to create a Generic Data Set:

1. Select a dataset for the source data. 🔰

   

2. Give a proper name, select a linked service and don't select any table. 🔰

   

3. Open the data set go to the parameter section and add the required parameters. (e.g.- Schema name, Table name) 🔰

   

   

   

4. Create one more data set for the storage. 🔰

   

5. Give a proper name, select a linked service and click on OK. 🔰

   

6. Open the dataset go to the parameter section and add the required parameter.(e.g.- filePath) 🔰

   

   

7. Now click on the debug, and we can see it asks for the parameter values, here we can provide any value. 🔰