Data Ingestion and Streaming
When you need to move a large amount of data in near-real time to different locations, typically for further processing or analysis, this is known as data streaming and ingestion. For example, imagine you run a warehouse with sensors on every part of each machine to measure the throughput of items, temperature, the color of the things in the warehouse, and so on. This would generate a huge amount of data that would need to be processed quickly and efficiently to generate alarms if there was a fault, or to automatically recalibrate the machines if they were out of alignment. AWS offers several different tools to handle the data, depending on your needs.
We will start this section by learning about Amazon Kinesis and its different features.
Amazon Kinesis
Amazon Kinesis is a platform on AWS to collect, process, and analyze real-time, streaming data, enabling you to get timely insights and react quickly to new information. It provides a set of services...