Consuming data products
To make existing data products readily usable, three key areas need to be addressed: discoverability, access request automation, and data composition ease. This section dives deeper into these crucial aspects of data product consumption.
Discovering data products
Scanning the observability ports of all deployed products to find the desired one is neither convenient nor efficient. To facilitate discovery, implementing a data product registry within the self serve platform is highly beneficial. This registry should not only store the main URL of each data product instance but also retain its complete descriptor, indexed appropriately to enable easy search.
Upon storing a data product’s descriptor, the registry should be capable of transmitting it, in its entirety or partially, to other metadata management tools. Essentially, the registry should operate as a data product hub. This approach allows, for example, sharing a data product’s metadata...
