The Azure SQL Table dataset specifies the SQL table in your SQL Database to which the data is to be copied. The Azure Blob dataset specifies the blob container and blob folder that contains the input blobs in your Blob storage. The Azure Storage and Azure SQL Database linked services contain connection strings that the service uses at runtime to connect to your Azure Storage and Azure SQL Database, respectively. Then, create two datasets: Azure Blob dataset (which refers to the Azure Storage linked service) and Azure SQL Table dataset (which refers to the Azure SQL Database linked service). To copy data from Blob storage to a SQL Database, you create two linked services: Azure Storage and Azure SQL Database. An Azure Blob dataset represents the blob container and the folder within that Azure Storage account that contains the input blobs to be processed. For example, an Azure Storage linked service links a storage account to the service. Think of it this way the dataset represents the structure of the data within the linked data stores, and the linked service defines the connection to the data source. Linked services are much like connection strings, which define the connection information needed for the service to connect to external resources. Now, a dataset is a named view of data that simply points to or references the data you want to use in your activities as inputs and outputs.īefore you create a dataset, you must create a linked service to link your data store to the Data Factory or Synapse Workspace.
For more information about pipelines and activities, see Pipelines and activities. Finally, you might use a second copy activity to copy the output data to Azure Synapse Analytics, on top of which business intelligence (BI) reporting solutions are built. Then, you might use a Hive activity that runs a Hive script on an Azure HDInsight cluster to process data from Blob storage to produce output data. For example, you might use a copy activity to copy data from SQL Server to Azure Blob storage. The activities in a pipeline define actions to perform on your data. A pipeline is a logical grouping of activities that together perform a task. OverviewĪzure Data Factory and Azure Synapse Analytics can have one or more pipelines. To learn more read the introductory article for Azure Data Factory or Azure Synapse.
This article describes what linked services are, how they're defined in JSON format, and how they're used in Azure Data Factory and Azure Synapse Analytics.
0 kommentar(er)
