Defining the data observability context

Following the data observability principles, the context of data manipulation is important. Now is a good time to define what we mean by context in data observability. We can define the context as the set of circumstances of the data transformations – in other words, they are the metadata that can help you understand how and where the data transformation or manipulation happened. The context will tell you which application manipulated the data, when it was manipulated, who executed the manipulation, what triggered it, and so on. This context should give you all the necessary pieces of information while you’re debugging the code or the data issue, both upstream (root cause analysis) and downstream (impact analysis).

Long story short, the context is the background of the application. It starts at the beginning of the script or program execution and lasts until all the data transformations the application was supposed to perform...