Creating the architectural layers

In this section, we will complete the layers of the Pragmatic Data Platform (PDP) architecture – staging/storage, refined, and the marts for delivery.

Figure 6.1: The layers that make up the Pragmatic Data Platform

Creating the Staging layer

In Chapter 4, we created the refined layer by adding the relevant configuration to the main configuration file, dbt_project.yml. Let’s do the same for the staging layer.

Add at the end of the main config file the configuration for the staging layer, as exemplified here:

    staging:    #Applies to all files under models/staging/
      +materialized: view
      +schema: STAGING

You can add it above or below the configuration for the refined layer, as you prefer, as long as it is indented correctly and at the same level as the refined config.

You can find the...