Data Pipeline 〽️

📍 Introduction:

In this post, we will see how to create our first data pipeline. Here we will move SQL data to an ADLS storage in CSV format.

Steps to create a data pipeline: 👁️‍🗨️

1. Create a linked service that will help to set up a connection to SQL DB 🔷

   

   1. Provide all the necessary details, click on Test Connection (this is to check if the connection is established successfully) and click on the Create button 🔷

      

      1. Now create one more linked service that will help us to get connected to ADLS 🔷

         

      2. Provide all the necessary details, click on Test Connection (this is to check if the connection is established successfully) and click on the Create button 🔷

         

1. Now create a data set that will help us to read the data from SQL DB 🔷

   

   1. Provide the table name and click on OK 🔷

      

      1. Create one more data set that will convert the table data to CSV 🔷

         

         1. Provide the file path where the data should be stored and click on OK 🔷

            

         2. Now Create a new pipeline with a Copy Activity 🔷

            

         3. Provide the necessary details in the source and sink option 🔷

            

            

            1. Click on the debug button and verify that the pipeline is executed successfully 🔷