Member-only story
How To Auto Trigger ADF When a Blob Is Uploaded In Storage Account
This article demonstrates how to use an event based trigger in ADF that can run ADF automatically when a file gets uploaded in Azure.
In this article, let’s handle another common scenario which a data engineer would usually be requested to account for— to be able to have a trigger in place that automatically executes an Azure Data Factory pipeline as soon as a file is uploaded in the storage account container.
Use Case:
ADF pipeline should run automatically as and when a file gets uploaded into the azure storage account container.Requirement:
As a Data engineer, I need to build a data pipeline that should get triggered anytime a user uploads a file in a specified storage account container. There shouldn’t be any recurring schedule attached to the pipeline but it should be able to run on an ad-hoc basis subjected to the availability of the dataset.
👉In my storage account container — dev I have created a folder called temp. I will create an ADF pipeline that will monitor this folder and whenever I upload a file named Azure File 1.xlsx, ADF pipeline should get triggered to do a certain activity.
Step 1: Create a Pipeline in ADF
In ADF, create a new pipeline and drag Get Metadata1 activity into the canvas.