Conjugating pipelines through a task tree
In this recipe, we will connect multiple tasks together in a tree to produce a data pipeline that performs multiple functions as it executes.
Getting ready
The following steps describe the various ways to create and schedule a task. Note that these steps can be run either in the Snowflake web UI or the SnowSQL command-line client.
How to do it…
To demonstrate the concept of a task tree, we will first create an aggregation query that we assume is being used in a report. We are assuming that the query takes a long time to run, therefore we are going to save the results of the query to a physical table and then refresh it periodically through a scheduled task. The steps are as follows:
- To simplify the process for you, we have used the sample data provided by Snowflake and created an aggregation query on top of that. (Please note that sample data is included with your Snowflake instance and can be found under the
SNOWFLAKE_SAMPLE_DATA...
