How To Create And Run a Python Script Using Azure Automation

This article explains how to run a python script in Azure Automation.

Let’s say you work in a team of 10 Data Engineers. Each engineer has developed a pipeline for a specific project that involves bringing data into temporary containers in Blob Storage. The containers are created at runtime. When the pipelines execute, the Project Manager needs a list of all such containers that were created. If this was a one-off request, you can either write a script in PowerShell/Python or do it manually. But, what if the pipelines run daily and the containers list also needs to go out daily?

This is where Azure Automation comes into picture. Azure Automation is a cloud-based automation service provided by Azure that enables users to automate tasks related to configuration and management of their cloud ecosystem.

Leveraging Azure Automation is the ideal solution to solve the above problem. As an example, below is a simple python script for Hello World that I will run through an Automation account.