Workflow: Part 2 — Passing Dynamic Values between Tasks in Databricks Workflow: A Comprehensive Guide.

This article explains values can be passed between tasks in Databricks workflow.

Curious about how Databricks workflow can be used to pass dynamic values between tasks? Read on.

IN my previous article, I detailed how you can setup a Databricks workflow pipeline, customize it to send alerts in case of failures and schedule it to run on a timely manner. If you are not familiar with setting up a databricks workflow, I highly recommend reading the below article to familiarize with it.

(Databricks Workflow pass values between tasks)

Tutorial: Setup Databricks Workflows To Run Pipelines in Databricks- Part 1

This part 2 explains how I can customize the databricks workflow to accept dynamic values.

PS — I will reuse the name workflow_POC from Part 1.

Use Case

Passing date values. In my databricks workflow, I need to pass a date value from one task to another task. The date value should show current date in YYYY-MM-DD format.