Managing data product data
Up to this point, we’ve explored how to identify data products to implement in order to support business cases, define the data each product manages and how it’s exposed, and finally, how to formally describe them using a data product descriptor. Let’s now see what are the points of attention to consider in the development of the internal components of a data product that deal with sourcing, processing, and serving data.
Sourcing data
The data product canvas allows you to determine which data each product needs, where it intends to retrieve it from, and how. All of this information can be formally described in the descriptor file in the section dedicated to input ports.
Each input port can acquire data of interest from an external system in the case of source-aligned data products or from another data product in all other cases. Regardless of the source, the data of interest can be communicated from the source to the data product...
