Setting up the latest data transform
While pivot data transforms are valuable for aggregating data and providing summaries for distinct entities, the latest data transform has a different application. It specifically replicates the most current document associated with each entity into the destination index. In this recipe, we will set up the latest data transform for our Rennes traffic data. The result of a data transform will help us to answer this question: For every route location, what was the last time the traffic jam happened?
Getting ready
To set up the latest data transform, you need to do and have the following:
- Complete the previous recipe of this chapter, Creating a Logstash pipeline
- At least one Elasticsearch node of your cluster set to the
transform
role
How to do it...
To further analyze the traffic data from Rennes and gain insights into traffic congestion, we can make use of Elastic Stack’s latest data transform feature to focus specifically...