“Trigger Your ADF Pipeline Instantly with Private Network Storage Event Trigger”

Trigger ADF Pipeline using Storage Event Trigger over Private Network
Introduction
Azure Data Factory (ADF) is a fully managed cloud-based data integration service that allows users to create data-driven workflows to move and transform data. It enables customers to orchestrate and automate data movement and data transformation activities in the cloud. ADF provides several triggers that can be used to start a pipeline execution. One such trigger is the Storage Event-based trigger. This trigger enables customers to start a pipeline execution when a file is created or modified in the Azure Storage linked service.

Advantages of Storage Event Trigger
The Storage Event Trigger provides a great way to schedule a pipeline execution, especially when the data is stored in Azure Storage. It is easy to configure and use. It is also very cost-effective as the pipeline can be triggered as soon as the data is available in the storage, without having to wait for a scheduled trigger.

Storage Event Trigger over Private Network
The Storage Event Trigger is a great way to trigger a pipeline execution when data is stored in an Azure Storage account. However, for customers who want to trigger the pipeline when data is stored in a private network, such as an on-premises network, the Storage Event Trigger is not available. To address this, Microsoft has released the Private Link feature, which enables customers to securely access Azure services, including Storage, over a private network. This feature allows customers to trigger an ADF pipeline execution when a file is created or modified in a private network, such as an on-premises network.

How to Configure Storage Event Trigger over Private Network
To configure the Storage Event Trigger over a private network, customers must first configure the Private Link feature in their Azure subscription. This involves creating a Private Link resource, linking the resource to an Azure Storage account, and creating a private endpoint. Once the Private Link feature is enabled, customers can then create a pipeline in ADF and configure the Storage Event Trigger to trigger the pipeline execution when a file is created or modified in the Storage account.

Conclusion
The Storage Event Trigger is a great way to trigger an ADF pipeline execution when data is stored in an Azure Storage account. With the addition of the Private Link feature, customers can now also trigger a pipeline execution when data is stored in a private network, such as an on-premises network. This feature makes it easy for customers to trigger a pipeline execution when data is available, without having to wait for a scheduled trigger.
References:
Trigger ADF pipeline using Storage event trigger over private network.
.

1. Azure Storage
2. ADF pipeline
3. Azure Event Trig