Member-only story

How To Auto Trigger ADF When a Blob Is Uploaded In Storage Account

This article demonstrates how to use an event based trigger in ADF that can run ADF automatically when a file gets uploaded in Azure.

Tech Zero
3 min readDec 2, 2021

In this article, let’s handle another common scenario which a data engineer would usually be requested to account for— to be able to have a trigger in place that automatically executes an Azure Data Factory pipeline as soon as a file is uploaded in the storage account container.

Use Case:
ADF pipeline should run automatically as and when a file gets uploaded into the azure storage account container.

Requirement:
As a Data engineer, I need to build a data pipeline that should get triggered anytime a user uploads a file in a specified storage account container. There shouldn’t be any recurring schedule attached to the pipeline but it should be able to run on an ad-hoc basis subjected to the availability of the dataset.

👉In my storage account container — dev I have created a folder called temp. I will create an ADF pipeline that will monitor this folder and whenever I upload a file named Azure File 1.xlsx, ADF pipeline should get triggered to do a certain activity.

Step 1: Create a Pipeline in ADF

In ADF, create a new pipeline and drag Get Metadata1 activity into the canvas.

--

--

Tech Zero
Tech Zero

Written by Tech Zero

Product Manager, Data & Governance | Azure, Databricks and Snowflake stack | Here to share my knowledge with everyone

No responses yet